-- Logs begin at Fri 2022-08-26 00:02:37 UTC, end at Fri 2022-08-26 01:22:35 UTC. -- Aug 26 00:43:11.623198 dv-osbrick-853500-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 00:43:11.631743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 00:43:11 2022] *** Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: nodename: dv-osbrick-853500-2-iscsi Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: machine: x86_64 Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: clock source: unix Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: pcre jit disabled Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: detected number of CPU cores: 4 Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: current working directory: / Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: detected binary path: /usr/bin/uwsgi-core Aug 26 00:43:11.633815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: your processes number limit is 47680 Aug 26 00:43:11.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: your memory page size is 4096 bytes Aug 26 00:43:11.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: detected max file descriptor number: 2048 Aug 26 00:43:11.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: lock engine: pthread robust mutexes Aug 26 00:43:11.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: thunder lock: enabled Aug 26 00:43:11.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 00:43:11.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 00:43:11.676024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: Python main interpreter initialized at 0x55a6f99559c0 Aug 26 00:43:11.676024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: python threads support enabled Aug 26 00:43:11.676024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: your server socket listen backlog is limited to 100 connections Aug 26 00:43:11.676024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: your mercy for graceful operations on workers is 90 seconds Aug 26 00:43:11.676563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 00:43:11.676563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: *** Operational MODE: preforking *** Aug 26 00:43:11.676812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: *** uWSGI is running in multiple interpreter mode *** Aug 26 00:43:11.676812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: spawned uWSGI master process (pid: 81622) Aug 26 00:43:11.677073 dv-osbrick-853500-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 26 00:43:11.677732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: spawned uWSGI worker 1 (pid: 81638, cores: 1) Aug 26 00:43:11.678531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: spawned uWSGI worker 2 (pid: 81639, cores: 1) Aug 26 00:43:11.678531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81622]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 00:43:16.367072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:43:16.367072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: from cryptography.utils import int_from_bytes Aug 26 00:43:16.367993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:43:16.367993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: from cryptography.utils import int_from_bytes Aug 26 00:43:16.403376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:43:16.403376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Aug 26 00:43:16.404416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:43:16.404416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Aug 26 00:43:16.421035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:43:16.421280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:43:16.421548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] command line args: [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:43:16.421920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:43:16.422184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ================================================================================ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:43:16.422525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] admin_token = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.422861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] config_dir = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.423136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.423406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] config_source = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.423675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] debug = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.423962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.425842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.425842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.425842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.425842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.426307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.426307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_config_append = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.426662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.426936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_dir = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.427264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.427637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.427983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.428360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.428706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.428979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.429249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.429586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.429925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.430256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.430610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.430933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.431263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.431601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.431969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.432373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.433445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.122/identity {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.433759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] publish_errors = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.434082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.434398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.434660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.435000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.435331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.435659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] standard_threads = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.435980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.436354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.436624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.436889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] use_journal = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.437158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] use_json = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.437418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] use_stderr = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.437678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] use_syslog = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.438211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.438453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.438783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.439469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.439812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.440220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.440561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.446288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.448146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.449254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.450383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.450383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.450383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.450383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.450847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.451143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.451469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.451796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.452271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.452536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.452865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.453205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.453346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:43:16.453484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:43:16.453626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.453768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] command line args: [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:43:16.453908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:43:16.454033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.454163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ================================================================================ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:43:16.454401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.454542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.454673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config_dir = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.454809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.454946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.455078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config_source = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.455078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] debug = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.455329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.455459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.455459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.455728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.455868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.456004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.456143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.456319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.456464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.456592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.456741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_config_append = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.456741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.456985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_dir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.457111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.457240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.457240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.457486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.457624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.457824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.457956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.458094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.458094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.458345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.458475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.458475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.458711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.458840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.458987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.459119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.459119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.459361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.459501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.459631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.459780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.459921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.460050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.460197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.460454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.460588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.460877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.122/identity {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.461031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.461177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] publish_errors = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.461307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.461446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.461576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.461713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.461841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.461969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.462096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.462237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.462368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] standard_threads = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.462541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.462674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.462803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.462940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.463080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.463854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_journal = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.464055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.464361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_json = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.464361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_stderr = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.464658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_syslog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.464838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.465022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:43:16.465198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.465378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.465378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.465684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.465865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.465865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.466155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.466339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.466339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.466605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.466748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.466945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.467983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.468247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.468457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.468600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.468801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.468801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.469879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.470971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.471107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.471107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.471361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.471549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.471549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.471876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.472962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.473889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474157 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.474913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.475909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.476040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.476232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.476499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.476499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.476744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.476876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.477968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.478099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.478238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.478370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.478565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.478704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.478950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.479127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.479312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.479528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.external = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.479751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.479905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.480093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.480368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.480525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.480661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.480848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.480969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.password = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.token = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.481957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.482100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.482244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.482531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.482667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.482796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.482927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.483863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.484935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.485068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.485229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.485362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.485493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.485721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.485877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.486967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.487930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.488063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.488351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.488486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.488618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.488750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.495464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.495464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.495859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.495996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.496904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.external = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.497954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.password = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.token = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.498984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.499952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.500894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.501870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.502937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.503908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.504966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.505806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.506938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.507917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.508931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.509864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.510515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.510623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.510726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.510726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.510942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.511984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.512114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.512274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.512390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.512503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.512614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.512889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.513917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.514927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.515933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.516934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.517907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.518963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.519862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.520048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.520113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.520198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.520264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.520264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.520368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.522716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.522716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.522981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.523892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.524919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.525046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.525159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.525159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.525419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.525578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.526222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.526360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.526360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.526595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.526748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.526748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] role.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] role.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.527877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.528962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.529998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.530828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.531913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.532193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.532336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.532492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.532690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.532830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.532967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.533180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.533437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.533575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.533710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.533877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.534952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.535084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.535290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.535441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.535574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.535755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.535894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.536970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.537172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.537319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.537452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.537625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.537922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.537922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.538992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.539129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.539316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.539451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.539586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.539782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.539933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.540078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.540310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.540419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.540561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.540709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.540806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.541045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.542948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.543979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.544115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.544342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.544478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.549490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.549490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.549814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.549944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.550597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.551633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.551633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.551633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.551633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.551633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.552178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.552305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.552674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.553098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.553515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.553941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.554401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.554850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.555299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.555750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.556252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.556707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.557875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.558631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.558770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.559163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:43:16.559474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:43:16.579133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.579374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.579588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.589468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.604348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.604602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.604823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.617662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.621670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.626312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.644902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.645126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.687007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.687669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.771489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.771848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.772348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.772664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.864022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.864391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.864534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.864700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.864924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.865142 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.895709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.896205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.896428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.896571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.896802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.897019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.897237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.910500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.953975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.954371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.954371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.954695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.954835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.955003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.975164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.975452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.975774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.976054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.976369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.976658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.976930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:16.986340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.000833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.001326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.001326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.001669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.001958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.002245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.002540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.009846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.011236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.011487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.011719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.011945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.012193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.012403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:43:17.021807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.022073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:43:17.022485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.022758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:43:17.022907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.023051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:43:17.023203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.023382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.023530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.023669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:43:17.023853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.023995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.024145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.024355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.024500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.024642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.035459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.035696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.035882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.036028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.036197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.036344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.036481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.036706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.044392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.044571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.047335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.047515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.047664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.047758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.047900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.048928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.049075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.049195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.049333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.049512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.049656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.049911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.050128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.050310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.050500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.050645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.072926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.074423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.074706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.074944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.076474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.076770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.079437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.079717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.079997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.081319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.081610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.081894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.086422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.086709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.089787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.089974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.091539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.091834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.092123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.092432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.092711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.092986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.093256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.093527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.094007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.094309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.094602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.094886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.095170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.095582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.095857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.096134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.111764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.112056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.113694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.114033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.115985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.118090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.119281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.119583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.121822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.122132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.123807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.126479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.126926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.129645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.130189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.130491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.130838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.131123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.131407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.131690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.132771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.133079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.133371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.133774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.134061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.134349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.148485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.148720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.148962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.149213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.152795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.153114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.153400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.153670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.156663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.158291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.158563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.160475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.161226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.161509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.161792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.162084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.162374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.163559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.163843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.167255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.167555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.167844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.168130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.168440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.173693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.173988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.174268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.174547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.174832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.175112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.175406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.179658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.179951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.180267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.180559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.180847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.181128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.181421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.190951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.194023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.196898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.198769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.199212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.200782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.201072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.201364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.201838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.204923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.206367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.207840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.207966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.208112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.208427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.209359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.212298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.213558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.213558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.213948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.216241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.217729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.220619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.220916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.221217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.221538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.222039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.222349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.222634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.229579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.229871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.230152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.230291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.230449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.230576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.230710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.230854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.230979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.231233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.231504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.231785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.232064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.232359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.232641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.232961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.233221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.237525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:43:17.237931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.238218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.238506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.238782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.239056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.239336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.239623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.239904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.240206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.240484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.240748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.241015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.241290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:43:17.268101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6f99559c0 pid: 81639 (default app) Aug 26 00:43:17.271991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845bede-8d25-4431-aeb3-f3040e10d21b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:17.272295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845bede-8d25-4431-aeb3-f3040e10d21b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:17.272565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845bede-8d25-4431-aeb3-f3040e10d21b None None] PATH_INFO: `/v3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:17.277504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6f99559c0 pid: 81638 (default app) Aug 26 00:43:17.277653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1/1] 10.222.0.122 () {50 vars in 796 bytes} [Fri Aug 26 00:43:17 2022] GET /identity/v3/ => generated 256 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:25.262236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:25.262887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:25.262887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:25.267283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1/2] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:25 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:25.274331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:25.274868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:25.274868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:25.346752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: INFO dbcounter [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] Registered counter for database keystone Aug 26 00:43:25.371624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG oslo_db.sqlalchemy.engines [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:43:25.378494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writer thread running {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:43:25.578185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG passlib.handlers.bcrypt [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81639) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:43:25.578598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG passlib.handlers.bcrypt [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81639) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:43:25.655287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:25.656958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:25.817024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 2/3] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:25 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 00:43:26.335786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:26.427741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: INFO dbcounter [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] Registered counter for database keystone Aug 26 00:43:26.448645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:43:26.457523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writer thread running {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:43:26.581327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22326cc-73b8-4b24-a05e-9f0c33f38fe9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:26.588274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:26.588828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:26.589109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:26.589380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:26.602486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:26.655261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:43:26.655602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf40129-79bb-43c5-914b-2f0230448eda admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:26.667003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 2/4] 10.222.0.122 () {58 vars in 1329 bytes} [Fri Aug 26 00:43:26 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 00:43:26.673278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:26.688107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadef4f3-9866-48a0-8e20-94d7aff63a94 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:26.692609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:26.693972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:26.694294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:26.694605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] PATH_INFO: `/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:26.696390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] RBAC: Authorizing `identity:get_project(project_id=18e8867d5ccb4ae190c4e3acc02760b8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:26.750202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:43:26.750530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c3231-7b84-4009-b2ef-674fbe9e1c4c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:26.755207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 3/5] 10.222.0.122 () {56 vars in 1212 bytes} [Fri Aug 26 00:43:26 2022] GET /identity/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:28.755870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9329f-03f7-4bad-b88b-9fb50fe57f16 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:28.756832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9329f-03f7-4bad-b88b-9fb50fe57f16 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:28.756832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9329f-03f7-4bad-b88b-9fb50fe57f16 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:28.761172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 3/6] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:28 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:43:28.767533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:28.768089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:28.768089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:28.791096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:28.792708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:28.804032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 4/7] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:28 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 00:43:29.087709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9329f-03f7-4bad-b88b-9fb50fe57f16 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:29.101807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9329f-03f7-4bad-b88b-9fb50fe57f16 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:29.106410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf587fc-aa4f-4f63-a8b7-51e2272fecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:29.107046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf587fc-aa4f-4f63-a8b7-51e2272fecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:29.107328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf587fc-aa4f-4f63-a8b7-51e2272fecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:29.107601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf587fc-aa4f-4f63-a8b7-51e2272fecf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:29.118169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf587fc-aa4f-4f63-a8b7-51e2272fecf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:29.120009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf587fc-aa4f-4f63-a8b7-51e2272fecf5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:29.131331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 4/8] 10.222.0.122 () {58 vars in 1329 bytes} [Fri Aug 26 00:43:29 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 00:43:29.137764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:29.147980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14395-4b31-40fc-878b-f298cb758600 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:29.152853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db83b2e-b248-4630-88a4-ee38496da5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:29.153528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db83b2e-b248-4630-88a4-ee38496da5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:29.153813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db83b2e-b248-4630-88a4-ee38496da5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:29.154092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db83b2e-b248-4630-88a4-ee38496da5b4 admin admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:29.155591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db83b2e-b248-4630-88a4-ee38496da5b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:29.157561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db83b2e-b248-4630-88a4-ee38496da5b4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:29.159309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 5/9] 10.222.0.122 () {56 vars in 1203 bytes} [Fri Aug 26 00:43:29 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:31.252640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4aad8-de2b-4b3e-9c40-a8b243eff0eb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:31.253486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4aad8-de2b-4b3e-9c40-a8b243eff0eb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:31.253486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4aad8-de2b-4b3e-9c40-a8b243eff0eb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.255212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 5/10] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:43:31.262330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8439fa-b2cf-443a-8071-f383f4c076c4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:31.262921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8439fa-b2cf-443a-8071-f383f4c076c4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:31.263294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8439fa-b2cf-443a-8071-f383f4c076c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.293581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7e8439fa-b2cf-443a-8071-f383f4c076c4 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:31.295126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7e8439fa-b2cf-443a-8071-f383f4c076c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:31.446687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 6/11] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:31.720500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4aad8-de2b-4b3e-9c40-a8b243eff0eb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:31.806107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6f63-8179-4d24-b9d9-a7b8587da490 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:31.806617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6f63-8179-4d24-b9d9-a7b8587da490 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:31.807111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a6f63-8179-4d24-b9d9-a7b8587da490 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.809622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 7/12] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:31 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:43:31.817225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:31.817597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:31.818080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.849178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:31.851556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:31.875729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:31.910780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4aad8-de2b-4b3e-9c40-a8b243eff0eb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:31.941699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 8/13] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:31.970948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:31.973282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:31.973808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:31.974297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.988701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:31.997758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:31.999298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:43:32.000958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 6/14] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:32.006021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.188575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ddeb-c461-4733-91f2-85539d64eb2c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:32.220560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.233834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:32.234425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:32.234790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:32.235250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:32.236144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:32.236545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:32.238566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:32.259786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:32.260572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 9/15] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:32.270901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.298892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:32.338809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5513c8-260c-459d-9080-7f676ccbf976 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:32.377083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:32.378253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:32.378500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:32.378776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:32.419096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb9adc-4dd9-490b-a3d1-90167ce6f8c4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:32.458626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:32.460188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:32.469933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:32.470591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:32.470875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:32.472297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:32.473192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:32.474784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:32.476614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 10/16] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:32.484245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.507023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:32.588183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:32.603852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 7/17] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:43:32.610988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ee67-4e7c-4580-9d5f-451e9e0e9d26 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:32.613892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.656072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:32.656720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:32.656994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:32.657261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:32.658408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:32.660470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:32.662046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 11/18] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:32.668192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.735086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fca09-a7fc-47c2-8dd9-0c4695395b0c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:32.771699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:32.772364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:32.772646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:32.772916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:32.775253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:32.790422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab64e0-a69c-4e44-aa9f-7d14bcc2a175 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:32.795710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:32.797200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:43:32.815586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:32.816782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:43:32.817720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:43:32.817720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:43:32.817720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:43:32.817720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 8/19] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:43:32.823150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:32.832786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:32.833446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:32.833723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:32.833994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:32.834729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.domain.id=default, user.id=609e79f5aa004dde93c22ba285ca6c56) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:32.835033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:32.836562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c48a-b7a5-4375-814c-af93bb4e1de3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:32.844529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 12/20] 10.222.0.122 () {56 vars in 1327 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/role_assignments?user.id=609e79f5aa004dde93c22ba285ca6c56&scope.domain.id=default&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 234 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:32.958670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be442a4a-10f6-4744-b4ac-887cb4b77b23 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:33.015837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:33.016428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:33.016715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:33.016989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:33.017690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:33.018036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:33.019566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c330f-69af-4aa4-9b83-457be37d076f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:33.041629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 9/21] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:35.934258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0851cd-49ae-4667-b317-72d7310955d0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:35.935076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0851cd-49ae-4667-b317-72d7310955d0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:35.935207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0851cd-49ae-4667-b317-72d7310955d0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:35.937886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 13/22] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:35 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:35.945226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:35.946032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:35.946181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:35.991072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81638) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:43:35.991670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81638) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:43:36.050173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:36.052873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f583b28d-7ee3-4309-b351-9902e1db9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:36.197684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae24c-56cf-4b6a-9b9d-7c7c74542261 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:36.198140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae24c-56cf-4b6a-9b9d-7c7c74542261 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:36.198622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae24c-56cf-4b6a-9b9d-7c7c74542261 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:36.201210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 14/23] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:43:36.208633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37049a-24dc-46ff-9137-fd5676d007c1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:36.209088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37049a-24dc-46ff-9137-fd5676d007c1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:36.209791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37049a-24dc-46ff-9137-fd5676d007c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:36.224747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:36.262754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3b37049a-24dc-46ff-9137-fd5676d007c1 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:36.266070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3b37049a-24dc-46ff-9137-fd5676d007c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:36.290133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:36.297502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 10/24] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:36.410923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 15/25] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:36.552253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c87b8-f042-4ac5-982c-72e0ff03b1f7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:36.552928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c87b8-f042-4ac5-982c-72e0ff03b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:36.553435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c87b8-f042-4ac5-982c-72e0ff03b1f7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:36.555037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 11/26] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:36.562898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889780-8942-47dc-84af-0c8eec199573 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:36.563214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889780-8942-47dc-84af-0c8eec199573 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:36.563567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889780-8942-47dc-84af-0c8eec199573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:36.593283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-54889780-8942-47dc-84af-0c8eec199573 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:36.594517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-54889780-8942-47dc-84af-0c8eec199573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:36.694366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 16/27] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:36.837546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c87b8-f042-4ac5-982c-72e0ff03b1f7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:36.915838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547e3d-a4a0-4df0-8c25-1d2ffe84a566 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:36.916482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547e3d-a4a0-4df0-8c25-1d2ffe84a566 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:36.916986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54547e3d-a4a0-4df0-8c25-1d2ffe84a566 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:36.918982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 17/28] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:36.925277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:36.925920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:36.926399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:36.969234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:36.972115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:37.057966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c87b8-f042-4ac5-982c-72e0ff03b1f7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:37.106716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 18/29] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:37.126184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:37.127427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.127986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.128555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.144941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:37.154261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:37.161016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:37.163822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:43:37.206906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:37.208791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:43:37.210359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:43:37.210359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:43:37.210359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:43:37.210359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 12/30] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:37.216382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:37.318571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:37.335688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f05f-77ad-43b1-bd08-8121f3985197 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:37.447520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:37.448089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.448385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.448744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.479078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:37.503084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:37.504025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:37.504818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:37.506879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 19/31] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:37.507783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:37.537550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451b379-83b6-4033-bcab-6b06a7ca5184 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:37.618873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:37.619277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.619781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.621733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.622027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:37.622586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:37.626128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:37.644968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:37.656140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 13/32] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:37.658318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:37.696135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c3e5a-c92a-44f9-b174-1a360f5d9929 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:37.743907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:37.744876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.745332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.745779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.746652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:37.748410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:37.849644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:37.881747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68151e-8af0-43d5-a70f-cfde0cb9834a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:37.928576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:37.929220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.929510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.929840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.930526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:37.930878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:37.932332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:37.947269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 14/33] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:37.948114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:38.063992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05234e-fe7c-4ffe-88d7-3c661aa0699e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:38.086913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 20/34] 10.222.0.122 () {60 vars in 1136 bytes} [Fri Aug 26 00:43:37 2022] POST /identity/v3/roles => generated 220 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:38.095186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:38.104895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:38.105934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.106234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.106557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.107261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:38.110624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:38.289538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1cab8-ced0-41d7-befb-f4b96f89922d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:38.323595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:38.324217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 15/35] 10.222.0.122 () {60 vars in 1136 bytes} [Fri Aug 26 00:43:37 2022] POST /identity/v3/roles => generated 226 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:38.325238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:38.336145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283db4f-08e5-4a8d-bb6a-930a25d3a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:38.336820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283db4f-08e5-4a8d-bb6a-930a25d3a20c None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.337171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283db4f-08e5-4a8d-bb6a-930a25d3a20c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.337510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283db4f-08e5-4a8d-bb6a-930a25d3a20c None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.339244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283db4f-08e5-4a8d-bb6a-930a25d3a20c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:38.339880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283db4f-08e5-4a8d-bb6a-930a25d3a20c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:38.341174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:38.451283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bdcd3-4fa9-4fb9-a6f9-0b486b9ff5a5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:38.475908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 21/36] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:43:38 2022] POST /identity/v3/projects => generated 302 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:38.478062 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09afec-8c94-4d16-8ace-a145f30da175 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.478610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09afec-8c94-4d16-8ace-a145f30da175 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.479106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09afec-8c94-4d16-8ace-a145f30da175 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.480791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 22/37] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:38.482362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64deb3-7d55-49dd-a10c-11de325eb5ed None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.482900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64deb3-7d55-49dd-a10c-11de325eb5ed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.483412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64deb3-7d55-49dd-a10c-11de325eb5ed None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.485800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 23/38] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:38.492240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.492887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.493403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.504695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14977-d343-46a7-828a-49922dfd38f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:38.505387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14977-d343-46a7-828a-49922dfd38f5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.505679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14977-d343-46a7-828a-49922dfd38f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.506113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14977-d343-46a7-828a-49922dfd38f5 None admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.508262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14977-d343-46a7-828a-49922dfd38f5 None admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:38.511261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14977-d343-46a7-828a-49922dfd38f5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:38.512560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 16/39] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:38 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:38.519526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.519815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.520105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.520433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:38.522451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:38.544070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:38.546238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:38.629048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 24/40] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:38.629992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:38.665611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 17/41] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:38.812894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f559964-47dd-4d94-abea-1f215f7168ae None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:38.825442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:38.874761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:38.876447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.877179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.877653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.879663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:38.882340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:38.890260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 25/42] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:38.893464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:38.905093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:38.924133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:39.012590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865d36-c67c-4297-91b3-1e50d554f37a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:39.072568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:39.073963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:39.074449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:39.074959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] PATH_INFO: `/v3/domains/default/users/609e79f5aa004dde93c22ba285ca6c56/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:39.079073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=609e79f5aa004dde93c22ba285ca6c56, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:39.081693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:39.083297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b760cc3-48a1-483f-aa32-fa916742fb67 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:39.122805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:39.123462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:39.123702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:39.123979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:39.124806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:39.126380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:39.176103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 18/43] 10.222.0.122 () {58 vars in 1366 bytes} [Fri Aug 26 00:43:38 2022] PUT /identity/v3/domains/default/users/609e79f5aa004dde93c22ba285ca6c56/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:43:39.176975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:39.206595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 26/44] 10.222.0.122 () {60 vars in 1136 bytes} [Fri Aug 26 00:43:38 2022] POST /identity/v3/roles => generated 224 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:43:39.269333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:39.318473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d993-5c8b-4b9b-a23b-bc3dce83d614 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:39.366926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e636e0-a2e3-4cf1-8d56-d210fb29dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:39.367794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e636e0-a2e3-4cf1-8d56-d210fb29dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:39.368268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e636e0-a2e3-4cf1-8d56-d210fb29dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:39.368707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e636e0-a2e3-4cf1-8d56-d210fb29dbf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:39.370222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e636e0-a2e3-4cf1-8d56-d210fb29dbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:39.372004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e636e0-a2e3-4cf1-8d56-d210fb29dbf6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:39.374280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 19/45] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:39.381270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:39.443853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:39.650341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a66e4-3c6a-48e2-85ed-9e73e0f328f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:39.692929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bd1c7-e0ba-4e55-b25c-d85b506076fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:39.693555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd1c7-e0ba-4e55-b25c-d85b506076fc None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:39.693831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd1c7-e0ba-4e55-b25c-d85b506076fc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:39.694160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd1c7-e0ba-4e55-b25c-d85b506076fc None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:39.694752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bd1c7-e0ba-4e55-b25c-d85b506076fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:39.696245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bd1c7-e0ba-4e55-b25c-d85b506076fc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:39.804689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 27/46] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:43:39 2022] POST /identity/v3/projects => generated 313 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:43:41.378260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03486-3f5f-4bb5-b9d3-9d4a85a8350a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:41.378892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03486-3f5f-4bb5-b9d3-9d4a85a8350a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:41.379386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03486-3f5f-4bb5-b9d3-9d4a85a8350a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:41.381823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 20/47] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:41 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:41.390734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e0fc2-74f3-4558-af71-7f860926eff7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:41.391508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e0fc2-74f3-4558-af71-7f860926eff7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:41.391719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e0fc2-74f3-4558-af71-7f860926eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:41.411999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f79e0fc2-74f3-4558-af71-7f860926eff7 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:41.413444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f79e0fc2-74f3-4558-af71-7f860926eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:41.493717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 28/48] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:41.783585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03486-3f5f-4bb5-b9d3-9d4a85a8350a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:41.926754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de2b3-43cf-4cc9-9f54-83540b59116e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:41.927119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de2b3-43cf-4cc9-9f54-83540b59116e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:41.927520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de2b3-43cf-4cc9-9f54-83540b59116e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:41.929116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 29/49] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:43:41.937723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:41.938223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:41.938653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:41.966431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:41.968874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:41.976678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03486-3f5f-4bb5-b9d3-9d4a85a8350a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:41.986173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:42.036422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.037524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.037983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.038417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.043622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:42.059477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:42.069731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:42.070873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:43:42.071841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 21/50] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:43:42.080215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 30/51] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:42.080766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:42.217759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7eff6-5025-495d-8f42-e49c3ab15297 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:42.256943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.257574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.257855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.258126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.258801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:42.259104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:42.260952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:42.273452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 22/52] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:42.282522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:42.375440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:42.399117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadff01-41d3-4fc3-a991-6f81b3be5ee5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:42.442847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.443125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.443336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.443731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.445127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:42.446886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:42.448894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 31/53] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:42 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:42.458231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:42.469727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:42.478761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:42.523845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fed73-5f08-466f-b8bb-b1c15f7586ff None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:42.574624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.575504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.575877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.576339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.578909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:42.580777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:42.582710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 23/54] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:42.588841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:42.610096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff919d-8ac9-4e16-8419-b68da7ee8cb7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:42.651609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.652200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.652487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.652763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.653938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:42.655469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:42.657270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 32/55] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:42.663292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:42.739450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6d70-7ead-45c0-b8ab-1bba000a7ca5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:42.775023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:42.786186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b17e0c-2fc7-4f4c-b79d-0937cccd5b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.787093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b17e0c-2fc7-4f4c-b79d-0937cccd5b96 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.787511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b17e0c-2fc7-4f4c-b79d-0937cccd5b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.787953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b17e0c-2fc7-4f4c-b79d-0937cccd5b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.788757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b17e0c-2fc7-4f4c-b79d-0937cccd5b96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:42.795250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b17e0c-2fc7-4f4c-b79d-0937cccd5b96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:42.795434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:42.815145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72d45-6d03-4e60-ac19-efa431505963 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:42.852432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:42.853134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:42.853421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:42.853698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:42.854439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.domain.id=default, user.id=609e79f5aa004dde93c22ba285ca6c56) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:42.854759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:42.856254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f0964-568d-44fb-abc0-bc78a604e6c4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:42.863042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 33/56] 10.222.0.122 () {56 vars in 1327 bytes} [Fri Aug 26 00:43:42 2022] GET /identity/v3/role_assignments?user.id=609e79f5aa004dde93c22ba285ca6c56&scope.domain.id=default&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 532 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:43:42.865738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 24/57] 10.222.0.122 () {60 vars in 1145 bytes} [Fri Aug 26 00:43:42 2022] POST /identity/v3/projects => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:43:44.863491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2067b1-89e4-4d43-ae89-5233a4a00f0d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:44.864023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2067b1-89e4-4d43-ae89-5233a4a00f0d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:44.864023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2067b1-89e4-4d43-ae89-5233a4a00f0d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:44.865426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 34/58] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:44.871182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:44.871651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:44.871785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:44.996477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:45.097804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:45.097804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 25/59] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:45.346223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2067b1-89e4-4d43-ae89-5233a4a00f0d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:45.477375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2067b1-89e4-4d43-ae89-5233a4a00f0d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:45.512263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad4a1-a49a-4a63-866e-b055c043ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:45.512900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad4a1-a49a-4a63-866e-b055c043ec99 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:45.513182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad4a1-a49a-4a63-866e-b055c043ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:45.513453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad4a1-a49a-4a63-866e-b055c043ec99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:45.515308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad4a1-a49a-4a63-866e-b055c043ec99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:45.516818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad4a1-a49a-4a63-866e-b055c043ec99 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:45.518408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 35/60] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:45 2022] GET /identity/v3/domains/default => generated 200 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:45.524291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:45.637962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e319-3b8f-4553-9c1b-9fab4077ea04 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:45.648703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:45.676502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113b8db-8197-4483-89e0-370b61f5ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:45.677129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113b8db-8197-4483-89e0-370b61f5ea51 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:45.677413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113b8db-8197-4483-89e0-370b61f5ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:45.677693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113b8db-8197-4483-89e0-370b61f5ea51 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:45.678372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113b8db-8197-4483-89e0-370b61f5ea51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:45.679864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113b8db-8197-4483-89e0-370b61f5ea51 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:45.790623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 26/61] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:43:45 2022] POST /identity/v3/users => generated 276 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:49.606419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96ee2-62a2-41a4-b76e-9e2dc5f0e80e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.607051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96ee2-62a2-41a4-b76e-9e2dc5f0e80e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.607130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96ee2-62a2-41a4-b76e-9e2dc5f0e80e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.608496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 36/62] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:49.624343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff632f-7770-41c8-a11d-8592cee0b3db None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.625274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff632f-7770-41c8-a11d-8592cee0b3db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.625753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff632f-7770-41c8-a11d-8592cee0b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.653426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cdff632f-7770-41c8-a11d-8592cee0b3db None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:49.655191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cdff632f-7770-41c8-a11d-8592cee0b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:49.659515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432885-11f8-4ba4-b196-b6eae020c924 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.660138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432885-11f8-4ba4-b196-b6eae020c924 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.660647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432885-11f8-4ba4-b196-b6eae020c924 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.662266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 37/63] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:43:49.674003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9704df2-4e8a-40cc-b18a-248bb8fd4d38 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.674308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9704df2-4e8a-40cc-b18a-248bb8fd4d38 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.674551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9704df2-4e8a-40cc-b18a-248bb8fd4d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.713219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a9704df2-4e8a-40cc-b18a-248bb8fd4d38 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:49.717201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a9704df2-4e8a-40cc-b18a-248bb8fd4d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:49.730875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:49.801137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 27/64] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:49.820334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473005b9-26cc-46a9-ba63-b1d44bcd08b1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.820992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473005b9-26cc-46a9-ba63-b1d44bcd08b1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.821460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473005b9-26cc-46a9-ba63-b1d44bcd08b1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.823305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 28/65] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:49.830514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60428c5b-1254-49f1-bae8-89402e197e69 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.831092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60428c5b-1254-49f1-bae8-89402e197e69 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.831566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60428c5b-1254-49f1-bae8-89402e197e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.838626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 38/66] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:49.859862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-60428c5b-1254-49f1-bae8-89402e197e69 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:49.861413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-60428c5b-1254-49f1-bae8-89402e197e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:49.895316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a2c7-d6a6-47be-bdc5-09bd5f98fb35 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.896437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a2c7-d6a6-47be-bdc5-09bd5f98fb35 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.897221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a2c7-d6a6-47be-bdc5-09bd5f98fb35 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.900531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 39/67] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:49 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:49.907650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.908617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.909402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.939597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:49.941122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:49.963843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 29/68] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:49.969817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6767-d115-4d56-85ce-4526b69ec855 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.970390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6767-d115-4d56-85ce-4526b69ec855 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.970866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6767-d115-4d56-85ce-4526b69ec855 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:49.972443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 30/69] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:49 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:49.978184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:49.978703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:49.979127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.017298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:50.018791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:50.033652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 40/70] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:50.052636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:50.095019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 31/71] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:50.156877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.244718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:50.272487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a33ce9-46d3-48d0-a2d9-b7c7f01315a8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.319346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.319997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.320306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.320588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.338370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:50.343863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:50.344976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:50.345863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:50.353591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 41/72] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:50.360454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.380960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.487915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbb576-9b93-45bf-8e44-4293d0a1de8f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.498233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8defc-43cf-408f-ad4c-07d520a042f0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.527314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.528847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.529337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.529696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.530384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:50.530691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:50.532413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:50.536938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.537585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.537900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.538141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.540208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:50.542534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 32/73] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:50.543988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.551482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:50.556534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:50.558195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:50.559878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 42/74] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:50.562588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.572519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:50.673149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f9c60-84fa-4182-87e4-ba4418a41237 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.683708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a97d-21d0-435a-8a05-c16739cee31c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.711848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.712536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.712816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.713093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.724688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.725334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.725563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:50.725655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.725876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:50.730855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:50.731889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:43:50.732701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:43:50.733306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 33/75] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:50.733686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.738658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:50.743547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:50.744539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:50.745314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 43/76] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:50.747558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.814894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:50.837799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:50.863969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f22918-c7c3-4f01-a0d5-d6b380aa67e2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.864907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866f90f-f1cc-424e-928b-80d97f55e059 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:50.901394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.902026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.902302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.903066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.904298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:50.905751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:50.907111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:50.907377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 34/77] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:50.908061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:50.908236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:50.908363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:50.908744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:50.935863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:50.938317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:50.941222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 44/78] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:50.945153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.035110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e976e-2793-4946-8532-de67c9a24278 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.062574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac32d9d-4ce1-4bb4-9147-3d52e221c118 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.072292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.072908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.073186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.073460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.074121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:51.075051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.076999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.079687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:51.086192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 35/79] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:51.087062 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.100104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:51.103018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.103481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.103760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.104031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.104729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:51.105033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.106551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.115436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 45/80] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:43:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:51.116285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.208927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0767-ed83-42d7-a794-a30a78c4d13d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.229433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a8496-9f23-4b4f-b58c-854a546316fe None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.245567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.246208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.247009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.247282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.247952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:51.248287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.249680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.258420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 36/81] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:51.259287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.270008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.270632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.270918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.271197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.271850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.273376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.340744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:51.377957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 46/82] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:43:51 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:51.378226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681e874-9ba5-4b28-8e2a-7229d4909888 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.381428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.427699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:51.436765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.437685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.444309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.444309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.535907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.537443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.561735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd921e1-62e7-445c-bf8a-b98b1991a501 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.611357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.611937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.612270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.613151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.614428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.616226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.618465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 47/83] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:51.618654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.639522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:51.731548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 37/84] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:43:51.732223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.771478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:51.777763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d216a-a2cf-45ed-9f1b-6ae9d5dcbe13 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.841077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.841736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.842012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.842308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.845377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.849620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.852538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 48/85] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:51.854433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.877482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8b24f-2a8a-4134-a57e-cac26182be5c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:51.916864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:51.917410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:51.917687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:51.918081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:51.919527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:51.921160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:51.922834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 38/86] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:51.923640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:51.973332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:52.033404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775a9c3-2b22-4d7c-8c97-200bc2e2bc3f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:52.049522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9646d-7e6b-4b59-8dec-284ec7731c97 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:52.077160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:52.078167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:52.078663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:52.079155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:52.088949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:52.089603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:52.090430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:52.090778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] PATH_INFO: `/v3/projects/46d7b0312adc45efbe4f177c8665a2a6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:52.091985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] RBAC: Authorizing `identity:get_project(project_id=46d7b0312adc45efbe4f177c8665a2a6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:52.093428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:52.099900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 39/87] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/projects/46d7b0312adc45efbe4f177c8665a2a6 => generated 313 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:52.099900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:52.140434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:52.217675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:52.220848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:52.306271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12d64-148f-4274-afb4-b34766811b5c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:52.314469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:52.398079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 49/88] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:43:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:43:52.398636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:52.400026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:52.401270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:52.401836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:52.402434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:52.498380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:52.545351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527424-ccff-44a9-9fce-90f4ccea7588 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:52.576482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:52.578152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:52.609875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:52.611038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:52.611462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:52.611910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:52.732794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 40/89] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:43:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:43:52.734665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:52.742017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:52.767336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:52.771042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:52.914645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:52.974943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b0e5-5fa3-4bf6-8fab-3b6d62b69179 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.001634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 50/90] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:43:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:43:53.003487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:53.049850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:53.051469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.052433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.053215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.054916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=46d7b0312adc45efbe4f177c8665a2a6, user.id=bf533d414187425ea006e350f6b6f292) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:53.055763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:53.058999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:53.075286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 41/91] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:43:52 2022] GET /identity/v3/role_assignments?user.id=bf533d414187425ea006e350f6b6f292&scope.project.id=46d7b0312adc45efbe4f177c8665a2a6&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 260 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:53.077532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:53.248832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:53.260015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cabec-0c97-4d1e-9cc0-8f4591b11faf None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.338919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:53.340024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.340550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.341029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.343388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:53.346074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:53.349237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 51/92] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:53 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:53.350667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:53.362443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c5d7-0f0f-4066-8c1d-167ff64ea8c9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.392818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:53.470693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd859c4d-01c4-4652-901a-d62d11bf37c2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.491563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:53.493281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.494048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.494931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.501941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:53.505458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:53.514520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 42/93] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:53 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:53.514746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:53.514746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.514746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.514746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.515263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:53.515263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:53.516716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 52/94] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:53 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:53.517355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:53.518369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:53.630894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eed4b-d145-45ca-96df-813c0cc74e99 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.634575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:53.675709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:53.676379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.676659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.676935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.677680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] RBAC: Adding query filter params (role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=bf533d414187425ea006e350f6b6f292) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:53.678040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:53.679603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:53.694685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 53/95] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:43:53 2022] GET /identity/v3/role_assignments?user.id=bf533d414187425ea006e350f6b6f292&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:53.697388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:53.814143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033d85b-62a7-4045-af6f-5c7a2da2a4c3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.896821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:53.899227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.899540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.899826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.900583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=bf533d414187425ea006e350f6b6f292) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:53.900902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:53.907771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89163a84-18da-4adf-8a36-4ffce1eb8025 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:53.915839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:53.924179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 43/96] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:43:53 2022] GET /identity/v3/role_assignments?user.id=bf533d414187425ea006e350f6b6f292&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 260 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:53.928544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7ed9a-f9ed-4998-affb-6e2c066502d8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.928961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7ed9a-f9ed-4998-affb-6e2c066502d8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.929414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7ed9a-f9ed-4998-affb-6e2c066502d8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.934033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 44/97] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:53 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:53.939936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fdaa3-6658-4754-9ba2-898b49cbcb0e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:53.940232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fdaa3-6658-4754-9ba2-898b49cbcb0e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:53.940538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fdaa3-6658-4754-9ba2-898b49cbcb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:53.943252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c070c-b8f2-44cd-83c1-843a7e743345 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:53.982973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dc8fdaa3-6658-4754-9ba2-898b49cbcb0e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:53.984340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dc8fdaa3-6658-4754-9ba2-898b49cbcb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:54.039191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:54.040792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:54.041653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:54.042428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:54.044704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=609e79f5aa004dde93c22ba285ca6c56) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:54.045763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:54.048992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb517f-77e2-488a-b364-dce9a559dfbc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:54.060931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 54/98] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:43:53 2022] GET /identity/v3/role_assignments?user.id=609e79f5aa004dde93c22ba285ca6c56&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:54.165331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 45/99] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:43:54.420887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cfb63-b338-46db-863e-e7647f0a3654 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:54.421562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cfb63-b338-46db-863e-e7647f0a3654 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:54.422058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cfb63-b338-46db-863e-e7647f0a3654 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:54.423978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 55/100] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:54.430256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:54.430546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:54.430829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:54.461264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:54.462504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:54.552682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 46/101] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:54.603852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cfb63-b338-46db-863e-e7647f0a3654 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:54.641017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:54.744311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cfb63-b338-46db-863e-e7647f0a3654 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:54.800333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:54.801011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:54.801296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:54.801617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:54.816313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:54.821280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:54.822217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:54.823014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 56/102] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:43:54.829693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:54.943800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:55.042612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe52e25-e306-484a-bb4c-5d49d130e6fa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:55.125910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:55.126960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:55.127477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:55.127976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:55.129232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:55.129775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:55.132122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:55.152783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 47/103] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:43:54 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:55.159613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:55.186297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:55.391579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:55.410364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a884-94a0-4506-add0-d0d0545d49dd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:55.425905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4a9b8-4afa-466a-a0b8-565307bfd2bb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:55.475284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:55.504133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:55.505266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:55.505749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:55.506203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:55.511499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:55.512583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:55.512716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:55.513195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:55.513705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] PATH_INFO: `/v3/users/b5926c1b2c97406997192a3bb83e865a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:55.514773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:55.516690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 48/104] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:43:55 2022] GET /identity/v3/domains/default => generated 200 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:55.524099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:55.561399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] RBAC: Authorizing `identity:get_user(user_id=b5926c1b2c97406997192a3bb83e865a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:55.564516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:55.567736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 57/105] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:55 2022] GET /identity/v3/users/b5926c1b2c97406997192a3bb83e865a => generated 290 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:55.575763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:55.831562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d931aa8-7c10-4179-9bee-b2304b5a9406 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:55.914445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:55.915482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:55.915990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:55.916540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:55.921191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:55.927083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:55.944768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cc79c-1791-4345-8b24-873d40b519e3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:56.035961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:56.036519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:56.036803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:56.037082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:56.068555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:56.083057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 49/106] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:43:55 2022] POST /identity/v3/projects => generated 303 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:43:56.122706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:56.126203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:56.375564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 58/107] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:43:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:43:56.381847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:56.503288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:56.647706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f6a67-fafc-44c3-9ce6-9dd5a086b5d7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:56.725805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1494e-2083-4a59-afc2-c82c6943ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:56.726914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1494e-2083-4a59-afc2-c82c6943ceec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:56.727408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1494e-2083-4a59-afc2-c82c6943ceec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:56.727895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1494e-2083-4a59-afc2-c82c6943ceec None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:56.730803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1494e-2083-4a59-afc2-c82c6943ceec None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:56.733525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1494e-2083-4a59-afc2-c82c6943ceec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:56.737007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 50/108] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:56 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:56.746983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:56.863272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:56.933584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397396-d00f-4477-ad4d-cf5b36a37b6b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:56.983296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:56.983921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:56.984228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:56.984511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:56.985253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] RBAC: Adding query filter params (role.id=c8c42f018e22458b869c2546bd5be59a, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=b5926c1b2c97406997192a3bb83e865a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:56.985620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:56.987048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a76d-b703-4482-a116-233ea96a4273 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:56.999592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 59/109] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:43:56 2022] GET /identity/v3/role_assignments?user.id=b5926c1b2c97406997192a3bb83e865a&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=c8c42f018e22458b869c2546bd5be59a => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:57.163675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e03f-593d-470b-bee3-5b6de402fbe9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.165223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e03f-593d-470b-bee3-5b6de402fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.165985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e03f-593d-470b-bee3-5b6de402fbe9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.168875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 51/110] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:57 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:57.177255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e327787-4e85-48ae-90ea-23426dba09b0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.177816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e327787-4e85-48ae-90ea-23426dba09b0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.178302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e327787-4e85-48ae-90ea-23426dba09b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.203125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1e327787-4e85-48ae-90ea-23426dba09b0 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:57.204702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1e327787-4e85-48ae-90ea-23426dba09b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:57.307287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 60/111] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:57.342830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3f87-e456-4a86-8c6d-f9446473a738 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.343653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3f87-e456-4a86-8c6d-f9446473a738 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.344429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3f87-e456-4a86-8c6d-f9446473a738 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.346953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 52/112] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:57 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:57.353153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.353529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.353734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.381579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:57.382842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:57.403839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12eef-6390-45cc-aa07-5b82b5755705 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.404945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12eef-6390-45cc-aa07-5b82b5755705 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.405737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12eef-6390-45cc-aa07-5b82b5755705 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.416194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 53/113] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:57 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:57.426633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.427306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.427919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.436909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:57.473921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 61/114] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:57.497394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:57.499443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:57.673827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 54/115] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:57.883460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.005391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.064244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd5771-611d-42a2-a58b-6b1157eecaf4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:58.170866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:58.192893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:58.194516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.195409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.196180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.241625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:58.260979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:58.262620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:58.264082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:58.268639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 62/116] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:43:58.270596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.287075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a637a1-397f-43f4-9d72-6b6541189cc3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:58.365332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:58.373175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:58.379395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.379395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.379395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.400185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:58.410648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:58.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:43:58.413920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:43:58.419306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 55/117] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:58.428913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.486999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12717-873d-421a-b06f-1f9015e1011e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:58.529108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fbe24-d370-4535-8adb-a22f0faae406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:58.529760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fbe24-d370-4535-8adb-a22f0faae406 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.530036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fbe24-d370-4535-8adb-a22f0faae406 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.530312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fbe24-d370-4535-8adb-a22f0faae406 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.543136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fbe24-d370-4535-8adb-a22f0faae406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9a6fbe24-d370-4535-8adb-a22f0faae406 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:58.548280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:58.549856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 63/118] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:58.551286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11965776-c37b-4127-8140-a19f1e3f1899 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.553822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11965776-c37b-4127-8140-a19f1e3f1899 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.553822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11965776-c37b-4127-8140-a19f1e3f1899 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.553822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 64/119] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:43:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:43:58.553822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11965776-c37b-4127-8140-a19f1e3f1899 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.627885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:58.633960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084095c-e930-4ecb-96e4-111d7d4047a7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:58.664028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:58.674806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11965776-c37b-4127-8140-a19f1e3f1899 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:58.701174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:58.702658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.703478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.704320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.705776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:58.706550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:58.709624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cdbac-0755-4ea1-befb-c0ce0e3caa4e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:58.717487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:58.718117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.718399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.718675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.719358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:58.719662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:58.721201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:58.728816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 56/120] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:43:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:58.731247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:58.736337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 65/121] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:43:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:58.736337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.737336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:58.738002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:58.769652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:58.772578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:58.867587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 57/122] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:43:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:43:58.868268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:58.935720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559157-9df2-4e7a-b975-5d0a00a5c358 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.030020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.030544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.030822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.031099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.031789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:59.032098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.033893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.051400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 66/123] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:43:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.052056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.071138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.095169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.103409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4297-79a9-4479-86f1-4485711afbd8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.182906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.183809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.183809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.184319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.185562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.187206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.189081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 58/124] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:58 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.194679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.201187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1ab8c-0000-4fe0-b8eb-0ffd161e78f7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.241048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.241931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.242089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.244439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.246723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.248032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.249773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 67/125] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.256225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.357390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.376418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e0eee-4b48-4c7a-adf8-91fdf7ae8b9f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.417587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.418614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.419044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.419272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23fcb9-39aa-4650-8623-11d3e389996f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.419621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.433109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:43:59.438855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:43:59.439857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:43:59.440765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:43:59.443228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 68/126] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:43:59.444360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.490316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.491571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.492094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.492782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.495002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.497667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.504902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 59/127] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.504902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.555227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.574042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9805a1-488f-4626-b53b-c5b207e8c8f6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.616357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.617285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.617749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.618217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.620569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.622608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.624943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 69/128] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.626077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.646129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.666593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e3e6-6453-4df0-8424-3d8ad84bd762 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.707241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.707894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.708201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.708484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] PATH_INFO: `/v3/projects/46d7b0312adc45efbe4f177c8665a2a6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.709971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] RBAC: Authorizing `identity:get_project(project_id=46d7b0312adc45efbe4f177c8665a2a6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.712075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.714545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 60/129] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/projects/46d7b0312adc45efbe4f177c8665a2a6 => generated 313 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.721097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.757308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722b21-2acd-4120-9b06-e5a0377de5f0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.802967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.803985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.804519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.805009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.805905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:59.806502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.809183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.819582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 70/130] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.820875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.831411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.840573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d38828-e2e7-462d-8716-ee9c5c44e058 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:59.879885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:59.880726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:59.881006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:59.881278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:59.882456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:59.883927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:59.890481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 61/131] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:43:59 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:59.890481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:59.929366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:59.969945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e6519-fe15-41dc-a1b0-a820c0aefcd1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:00.015797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:00.016872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.017325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.017779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/bf533d414187425ea006e350f6b6f292/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.021912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] RBAC: Authorizing `identity:create_grant(project_id=95e27803c0c0485da5f8d29ddcc12933, user_id=bf533d414187425ea006e350f6b6f292, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:00.025133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:00.038697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797daf-7979-4e9b-b10d-54affa114ead None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:00.081661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:00.082340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.082620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.082893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] PATH_INFO: `/v3/projects/46d7b0312adc45efbe4f177c8665a2a6/users/bf533d414187425ea006e350f6b6f292/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.084935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] RBAC: Authorizing `identity:create_grant(project_id=46d7b0312adc45efbe4f177c8665a2a6, user_id=bf533d414187425ea006e350f6b6f292, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:00.086480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:00.105587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 71/132] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:43:59 2022] PUT /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/bf533d414187425ea006e350f6b6f292/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:00.106983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:00.198502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 62/133] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:43:59 2022] PUT /identity/v3/projects/46d7b0312adc45efbe4f177c8665a2a6/users/bf533d414187425ea006e350f6b6f292/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:00.201751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:00.275939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:00.329974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c961-ead9-4860-84c3-71853433ca3f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:00.405294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a802f-7757-4a54-b08d-850d4a05c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:00.406061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a802f-7757-4a54-b08d-850d4a05c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.410015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a802f-7757-4a54-b08d-850d4a05c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.411414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a802f-7757-4a54-b08d-850d4a05c2e4 None admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.413808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a802f-7757-4a54-b08d-850d4a05c2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:00.417232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a802f-7757-4a54-b08d-850d4a05c2e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:00.420551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 72/134] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:00 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:00.424362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a06fc-ae5b-4fe4-ae4b-82f14d7042f3 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.424856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a06fc-ae5b-4fe4-ae4b-82f14d7042f3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.428031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a06fc-ae5b-4fe4-ae4b-82f14d7042f3 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.430662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 73/135] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:00 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:00.439378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3cacb-2ca4-4297-8699-9acd7918f4d7 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.439863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3cacb-2ca4-4297-8699-9acd7918f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.440358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3cacb-2ca4-4297-8699-9acd7918f4d7 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.441846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fe91d-70ac-40cf-8ed4-2cf6a46ac48b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:00.446177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 74/136] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:00 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:00.452528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.452909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.453471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.466746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:00.485685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:00.488128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:00.521631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c99a-2c08-40db-91ec-c21645f0fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:00.522878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c99a-2c08-40db-91ec-c21645f0fef0 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.523430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c99a-2c08-40db-91ec-c21645f0fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.524042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c99a-2c08-40db-91ec-c21645f0fef0 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/bf533d414187425ea006e350f6b6f292/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.529411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c99a-2c08-40db-91ec-c21645f0fef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e27803c0c0485da5f8d29ddcc12933, user_id=bf533d414187425ea006e350f6b6f292, role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:00.532258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c99a-2c08-40db-91ec-c21645f0fef0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:00.597502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 75/137] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:00.600053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:00.630984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 63/138] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:00 2022] PUT /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/bf533d414187425ea006e350f6b6f292/roles/6597e480361e45bbb37dc41cff9e4582 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:00.640228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:00.640228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:00.640228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:00.697551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:00.697551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:00.988014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c594-0c3b-4ac9-b0d6-df96003d81f9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:01.016595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 64/139] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:01.077126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:01.084281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:01.085980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:01.086726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:01.088654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:01.092857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:01.095037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:01.099358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 76/140] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:00 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:01.109681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:01.156532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:01.260698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:01.354031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd89ad-18b2-44c0-a5d9-2e8a104124c1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:01.428333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:01.429432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:01.429917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:01.430414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/609e79f5aa004dde93c22ba285ca6c56/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:01.434795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e27803c0c0485da5f8d29ddcc12933, user_id=609e79f5aa004dde93c22ba285ca6c56, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:01.437515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:01.519125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 65/141] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:01 2022] PUT /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/609e79f5aa004dde93c22ba285ca6c56/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:01.522433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:01.618354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d36b1-1bf5-4f3b-bbd5-78ec1811cfc3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:01.711777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:01.712571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:01.712856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:01.713209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:01.714521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:01.716419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:01.717419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:01.719404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 77/142] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:01.725784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:01.777840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0a773-8555-4d76-8202-1f93ee0ee053 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:01.823215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:01.846703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:01.847914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:01.848384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:01.848830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:01.868376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7ce21-3301-4330-87e2-4033b74c588f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:01.874087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:01.884309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:01.885475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:01.886338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:01.888033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 66/143] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:01.897424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:01.916824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:01.917738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:01.918193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:01.918669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:01.919523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:01.921399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:02.031639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 78/144] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:01 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:44:02.088683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49618d3-46a6-4b40-b187-a2c124500e56 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:02.156533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:02.157517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:02.157942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:02.158374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:02.159532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:02.160055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:02.162644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:02.165426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:02.180478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 67/145] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:01 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:02.189517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:02.420780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fbf3-09c9-4f6c-ae04-acaf6ff5ead8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:02.456195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:02.470033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:02.471111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:02.471685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:02.472164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] PATH_INFO: `/v3/users/b5926c1b2c97406997192a3bb83e865a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:02.474230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] RBAC: Authorizing `identity:get_user(user_id=b5926c1b2c97406997192a3bb83e865a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:02.477232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:02.481006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 79/146] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:02 2022] GET /identity/v3/users/b5926c1b2c97406997192a3bb83e865a => generated 290 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:02.489963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:02.685722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd7c9-ebea-46bf-8bf2-30569fcbf333 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:02.753661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f38317-0ad0-431a-b1e6-54b2bcd2d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:02.754929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f38317-0ad0-431a-b1e6-54b2bcd2d049 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:02.755423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f38317-0ad0-431a-b1e6-54b2bcd2d049 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:02.755886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f38317-0ad0-431a-b1e6-54b2bcd2d049 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:02.758012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f38317-0ad0-431a-b1e6-54b2bcd2d049 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:02.761259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f38317-0ad0-431a-b1e6-54b2bcd2d049 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:02.764489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 68/147] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:02 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:02.773661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:02.980268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee439e7-d414-45b8-89d0-6a703de0768d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:03.050139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366f067-a66c-43e3-b950-b052b022833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:03.051290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366f067-a66c-43e3-b950-b052b022833a None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:03.051765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366f067-a66c-43e3-b950-b052b022833a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:03.052267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366f067-a66c-43e3-b950-b052b022833a None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/b5926c1b2c97406997192a3bb83e865a/roles/c8c42f018e22458b869c2546bd5be59a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:03.056578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366f067-a66c-43e3-b950-b052b022833a None admin] RBAC: Authorizing `identity:create_grant(project_id=95e27803c0c0485da5f8d29ddcc12933, user_id=b5926c1b2c97406997192a3bb83e865a, role_id=c8c42f018e22458b869c2546bd5be59a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:03.059108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366f067-a66c-43e3-b950-b052b022833a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:03.160914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 80/148] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:02 2022] PUT /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933/users/b5926c1b2c97406997192a3bb83e865a/roles/c8c42f018e22458b869c2546bd5be59a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:03.254345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef6ec-e202-4544-ba6f-b276b6fc980e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:03.254991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef6ec-e202-4544-ba6f-b276b6fc980e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:03.255562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef6ec-e202-4544-ba6f-b276b6fc980e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:03.258292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 69/149] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:03 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:03.268271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ac837-972b-4350-b078-95b41f7a2e6d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:03.268271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ac837-972b-4350-b078-95b41f7a2e6d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:03.268271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ac837-972b-4350-b078-95b41f7a2e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:03.288014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-747ac837-972b-4350-b078-95b41f7a2e6d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:03.289743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-747ac837-972b-4350-b078-95b41f7a2e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:03.375158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:03.417478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 81/150] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:04.113277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf166-dae2-4427-838c-df7d396bf868 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:04.113795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf166-dae2-4427-838c-df7d396bf868 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:04.114214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf166-dae2-4427-838c-df7d396bf868 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:04.116892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 70/151] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:04 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:04.124663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:04.125166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:04.125628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:04.169943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:04.171995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:04.300604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 82/152] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:04.398651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbf166-dae2-4427-838c-df7d396bf868 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:04.640656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:04.693128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbf166-dae2-4427-838c-df7d396bf868 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:04.765174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:04.766218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:04.766718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:04.767186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:04.796074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:04.801264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:04.802154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:04.802921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:04.805296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 71/153] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:04.818086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:05.013751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9726-7df8-4aee-9c8a-c1c73d30b42b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:05.039170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:05.074518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:05.075582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:05.076106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:05.076618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:05.077526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:05.078049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:05.079698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:05.100035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 83/154] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:04 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:05.113791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:05.286742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03f00-2821-4432-90c0-c80e18eaccb9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:05.327081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:05.340355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:05.346876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:05.346876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:05.346876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:05.346876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:05.346876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:05.346876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 72/155] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:05 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:05.352489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:05.407381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:05.540722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b715a-24f1-45bf-81c1-a1f9dbbb9559 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:05.615286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:05.615924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:05.616230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:05.616613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:05.648443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e75f4-dd1d-4143-bb67-980892c50ba5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:05.725536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:05.742896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:05.743938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:05.744260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:05.744543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:05.789331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:05.795802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:05.796699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:05.797478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:05.810252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 73/156] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:05.810826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:05.812405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:05.833403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:05.966599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:06.027150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff3fb8-6c49-43c5-ab13-a3daa874e5c1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:06.068841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:06.069520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.069808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.070080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.070822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:06.071186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:06.073048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:06.083457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 74/157] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:06.090897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:06.132045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 84/158] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:06.141900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:06.215993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14f44-eafd-468e-af32-ab0f3e0bbeea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:06.233589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:06.258789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:06.260684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.260970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.261245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.262481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:06.265010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:06.267036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 75/159] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:06 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:06.273427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:06.404268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a608-3076-4058-8b82-77706b7db7f6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:06.404439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:06.446091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0379d2-443a-4478-bcad-4688954f9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:06.447107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0379d2-443a-4478-bcad-4688954f9fce None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.447919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0379d2-443a-4478-bcad-4688954f9fce None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.448399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0379d2-443a-4478-bcad-4688954f9fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.470695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442072ae-0072-41a0-b522-a3354dff2f4f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:06.512438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:06.540678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0379d2-443a-4478-bcad-4688954f9fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:06.542779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0379d2-443a-4478-bcad-4688954f9fce None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:06.608201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:06.609184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.609618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.610046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.611480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:06.613160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:06.615077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 85/160] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:06 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:06.625982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:06.715255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 76/161] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:06.721232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fc2b-f2cd-440c-8560-c46a1d628ac8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.721853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fc2b-f2cd-440c-8560-c46a1d628ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.722277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fc2b-f2cd-440c-8560-c46a1d628ac8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.724231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 77/162] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:06 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:06.725754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fc2b-f2cd-440c-8560-c46a1d628ac8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:06.876408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35d5b-88d7-4349-ba12-1ef5855f2c49 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:06.932365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:06.933302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.933755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.934310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.935267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=bf533d414187425ea006e350f6b6f292) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:06.935763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:06.937537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86c12e-3d65-43e2-9e57-445fe0399474 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:06.944815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 86/163] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:06 2022] GET /identity/v3/role_assignments?user.id=bf533d414187425ea006e350f6b6f292&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 610 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:06.946791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b36f87-3d28-476e-8c17-2ca04e91cd3c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:06.947444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b36f87-3d28-476e-8c17-2ca04e91cd3c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:06.947885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b36f87-3d28-476e-8c17-2ca04e91cd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:06.965805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:06.968752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-03b36f87-3d28-476e-8c17-2ca04e91cd3c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:06.970254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-03b36f87-3d28-476e-8c17-2ca04e91cd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:06.989766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:07.042393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fc2b-f2cd-440c-8560-c46a1d628ac8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:07.093838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b64cc-1232-4865-8202-328bebcfa558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:07.094828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b64cc-1232-4865-8202-328bebcfa558 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:07.095316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b64cc-1232-4865-8202-328bebcfa558 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:07.095972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b64cc-1232-4865-8202-328bebcfa558 None admin] PATH_INFO: `/v3/projects/46d7b0312adc45efbe4f177c8665a2a6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:07.097536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b64cc-1232-4865-8202-328bebcfa558 None admin] RBAC: Authorizing `identity:get_project(project_id=46d7b0312adc45efbe4f177c8665a2a6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:07.099262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b64cc-1232-4865-8202-328bebcfa558 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:07.101971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 78/164] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:06 2022] GET /identity/v3/projects/46d7b0312adc45efbe4f177c8665a2a6 => generated 313 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:07.109512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bfe84-a30d-40b7-9a45-939c9809de92 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:07.110079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bfe84-a30d-40b7-9a45-939c9809de92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:07.110698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bfe84-a30d-40b7-9a45-939c9809de92 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:07.112322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 79/165] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:07 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:07.113276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bfe84-a30d-40b7-9a45-939c9809de92 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:07.116753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 87/166] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:07.122634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a4ab3-40f1-4474-b6b6-414ca178fd2e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:07.123202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a4ab3-40f1-4474-b6b6-414ca178fd2e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:07.123760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a4ab3-40f1-4474-b6b6-414ca178fd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:07.174028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-769a4ab3-40f1-4474-b6b6-414ca178fd2e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:07.176270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-769a4ab3-40f1-4474-b6b6-414ca178fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:07.301510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bfe84-a30d-40b7-9a45-939c9809de92 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:07.374189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:07.375386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:07.375861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:07.376354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:07.377312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=46d7b0312adc45efbe4f177c8665a2a6, user.id=bf533d414187425ea006e350f6b6f292) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:07.377812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:07.379885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ae3a-eacd-4a54-a5a0-46c59e297c8b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:07.393478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 80/167] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:07 2022] GET /identity/v3/role_assignments?user.id=bf533d414187425ea006e350f6b6f292&scope.project.id=46d7b0312adc45efbe4f177c8665a2a6&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 610 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:07.420568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 88/168] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:07.567877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434cecd-73eb-4161-80fc-cd3813e76444 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:07.568550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434cecd-73eb-4161-80fc-cd3813e76444 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:07.569018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434cecd-73eb-4161-80fc-cd3813e76444 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:07.570653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 81/169] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:07.588354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:07.588829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:07.589307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:07.630354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:07.633461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:07.793347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:07.801642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 89/170] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:08.059927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434cecd-73eb-4161-80fc-cd3813e76444 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.074506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.078000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:08.270609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbc20c-8212-4c3e-a2a3-239bc2f9da42 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:08.315112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2bf70-a4ea-4fcb-88da-2546613d21cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:08.316053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2bf70-a4ea-4fcb-88da-2546613d21cb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.316488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2bf70-a4ea-4fcb-88da-2546613d21cb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.316923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2bf70-a4ea-4fcb-88da-2546613d21cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.329667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2bf70-a4ea-4fcb-88da-2546613d21cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:08.333097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434cecd-73eb-4161-80fc-cd3813e76444 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-33d2bf70-a4ea-4fcb-88da-2546613d21cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:08.334974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:08.337739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 90/171] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:08.339116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e491-dfd1-4394-bd36-1b2f1a9232cc None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.339933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e491-dfd1-4394-bd36-1b2f1a9232cc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.339933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e491-dfd1-4394-bd36-1b2f1a9232cc None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.345096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 91/172] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:08.346652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.346927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.347359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.366472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:08.368282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:08.421696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cb33f-85e4-44cf-81b1-e87a84f22997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:08.423674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb33f-85e4-44cf-81b1-e87a84f22997 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.424719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb33f-85e4-44cf-81b1-e87a84f22997 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.424884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb33f-85e4-44cf-81b1-e87a84f22997 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.430690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:08.451421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 92/173] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:08.453517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.455773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cb33f-85e4-44cf-81b1-e87a84f22997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c89cb33f-85e4-44cf-81b1-e87a84f22997 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:08.468092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:08.469234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:08.470029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:08.470637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 82/174] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:08.474514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e879-1fa5-4721-8cfc-1629b54fd281 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.475027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e879-1fa5-4721-8cfc-1629b54fd281 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.475466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e879-1fa5-4721-8cfc-1629b54fd281 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.477977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 83/175] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:08 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:08.485993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43e879-1fa5-4721-8cfc-1629b54fd281 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.600399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8481-8235-42a0-9ab5-78834e6ca089 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:08.635204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:08.642265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:08.643098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.643442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.643721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.644448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:08.651043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:08.651043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:08.662487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 93/176] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:08.663826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.714649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43e879-1fa5-4721-8cfc-1629b54fd281 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:08.723275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:08.782295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2e871-0ba5-458b-94cf-bda5ab4d73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:08.784197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e625f9-fa4d-474a-b38e-b14ba1ce79e5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:08.788497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2e871-0ba5-458b-94cf-bda5ab4d73a2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.789033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2e871-0ba5-458b-94cf-bda5ab4d73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.789543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2e871-0ba5-458b-94cf-bda5ab4d73a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.809114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2e871-0ba5-458b-94cf-bda5ab4d73a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a6e2e871-0ba5-458b-94cf-bda5ab4d73a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:08.819044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:08.820510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:08.821331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:08.822600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 84/177] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:08.823013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.823338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.823671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.824795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:08.825416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.825698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.825972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:08.826649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:08.826953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:08.828410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:08.838606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 94/178] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:08.840872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.847318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:08.848993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:08.948335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 85/179] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:08.949428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:08.957249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0488276-a02d-4e97-9936-c287a0aa9fc9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:08.970635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:08.998577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8659f-7f94-469d-970d-8de3ff1f88e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:08.999223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8659f-7f94-469d-970d-8de3ff1f88e8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:08.999502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8659f-7f94-469d-970d-8de3ff1f88e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:08.999847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8659f-7f94-469d-970d-8de3ff1f88e8 None admin] PATH_INFO: `/v3/users/609e79f5aa004dde93c22ba285ca6c56` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.001114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8659f-7f94-469d-970d-8de3ff1f88e8 None admin] RBAC: Authorizing `identity:get_user(user_id=609e79f5aa004dde93c22ba285ca6c56)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:09.002589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8659f-7f94-469d-970d-8de3ff1f88e8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:09.004655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 95/180] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/users/609e79f5aa004dde93c22ba285ca6c56 => generated 248 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:09.010567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c6eec-1e1b-494e-890d-ae000beabfb0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.010852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c6eec-1e1b-494e-890d-ae000beabfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.011127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c6eec-1e1b-494e-890d-ae000beabfb0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.012597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 96/181] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:09.013140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c6eec-1e1b-494e-890d-ae000beabfb0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:09.033040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:09.093111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce027-56f8-4862-be1a-9a83928ef9ca None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:09.149960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c6eec-1e1b-494e-890d-ae000beabfb0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:09.163076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:09.164700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.165167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.165598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.167612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:09.169883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:09.176288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 86/182] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:09.176288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:09.210808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:09.211330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.211828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.212089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.212767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:09.213063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:09.214513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:09.224858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 97/183] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:09.225755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:09.287699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:09.332749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c803d0-43bc-4899-86d3-3e6ec5d32355 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:09.368495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:09.373918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6fe4-4ab9-44be-ba62-7de0ad0992be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:09.374559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6fe4-4ab9-44be-ba62-7de0ad0992be None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.374849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6fe4-4ab9-44be-ba62-7de0ad0992be None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.375162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6fe4-4ab9-44be-ba62-7de0ad0992be None admin] PATH_INFO: `/v3/users/bf533d414187425ea006e350f6b6f292` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.376340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6fe4-4ab9-44be-ba62-7de0ad0992be None admin] RBAC: Authorizing `identity:get_user(user_id=bf533d414187425ea006e350f6b6f292)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:09.377825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6fe4-4ab9-44be-ba62-7de0ad0992be None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:09.383058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 87/184] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:09 2022] GET /identity/v3/users/bf533d414187425ea006e350f6b6f292 => generated 276 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:09.383058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.383058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.383058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.391163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8dc98-3b49-40a7-a9b4-df58f09d39bd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:09.401936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:09.403722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:09.438055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:09.438682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.438976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.439250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.516294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 88/185] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:09.516294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:09.527400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:09.529981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:09.604958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:09.667298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04cb06-a133-4c5b-9cac-2403be835897 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:09.723533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:09.733709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:09.734770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.735253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.735735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.736971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:09.739750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:09.745478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 98/186] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:09.751637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:09.849446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 89/187] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:09 2022] POST /identity/v3/users => generated 298 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:09.862056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:09.904554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711db3a-6be2-4c9d-a522-e0ac6badca2a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:09.969910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:09.970745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:09.971033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:09.971298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:09.981764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:09.985735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:09.990657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:09.997501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 99/188] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:09.999625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:10.046398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70107b77-5606-4d0e-ac1e-23cb964b6e12 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:10.106825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:10.106825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:10.106825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:10.107266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] PATH_INFO: `/v3/users/8ed0fca87db44d5089e017f162a35d34` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:10.135714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed0fca87db44d5089e017f162a35d34)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:10.137241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:10.139617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 90/189] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:09 2022] GET /identity/v3/users/8ed0fca87db44d5089e017f162a35d34 => generated 284 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:10.144969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:10.160283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2886-4035-4fd1-916f-75ac54329946 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:10.226653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:10.240473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:10.242410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:10.243071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:10.243515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:10.328672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1509-31bb-4b70-91c4-0bb2ff95a713 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:10.355335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:10.359865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:10.362751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:10.384008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:10.385291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:10.385735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:10.386186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:10.392964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:10.394925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:10.397530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 91/190] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:10 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:10.398699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:10.531447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72ca3-cb65-4b34-aa88-da1b7c0d84bd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:10.552229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:10.559192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 100/191] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:10.560515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:10.591014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:10.592441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:10.593179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:10.593933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:10.618997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:10.633834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:10.639339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 92/192] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:10.640139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:10.822838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:10.828490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260a522-1ef3-4215-9400-37adcf0b3046 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:10.876436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581e897-919f-46af-b797-9521c102dd3e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:10.896642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:10.899003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:10.899630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:10.900216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:10.901595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:10.902120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:10.904795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:10.920858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 101/193] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:10.922691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:10.942568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:10.943873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:10.945126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:10.945918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.022466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:11.071666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.074650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.122181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893c94f-d96b-4dc0-b6a2-e2ea5e7e8b34 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.188371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.189243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.189710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.190168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.191456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=609e79f5aa004dde93c22ba285ca6c56) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:11.192039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.196205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.207103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 102/194] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:10 2022] GET /identity/v3/role_assignments?user.id=609e79f5aa004dde93c22ba285ca6c56&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:11.212838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.266435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 93/195] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:11.268443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.327006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:11.409698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:11.478800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79bad-6c15-4344-910b-ca7d965deab2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.566966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.567610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.567886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.568188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.568881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:11.569185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.571563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.582534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 94/196] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:11.583418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.596701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8d3e-4d67-4ca7-be73-335be0cf160b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.648224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.648902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.649153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.649432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.650728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.652516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.654243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 103/197] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:11 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:11.655058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.802859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:11.811256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a739f8-35dc-4713-8bb9-44a2199a41d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.834630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a43ce-a6fb-4036-bd5c-31a26306b45f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.864354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.865674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.866705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.866957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.868791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.870688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.872888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 104/198] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:11 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:11.874272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.914357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.916411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.916725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.917104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] PATH_INFO: `/v3/users/8ed0fca87db44d5089e017f162a35d34` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.919059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] RBAC: Authorizing `identity:get_user(user_id=8ed0fca87db44d5089e017f162a35d34)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.920838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.923600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 95/199] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:11 2022] GET /identity/v3/users/8ed0fca87db44d5089e017f162a35d34 => generated 284 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:11.925705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.932534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.099894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c005e2-0aaa-47fa-90f4-ccbd953db67a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:12.139357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4aaeb-f9d0-4ca9-9d4f-70162bd45bb3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:12.142256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:12.142976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.143495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.143671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.144557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] RBAC: Adding query filter params (role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=bf533d414187425ea006e350f6b6f292) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:12.144930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:12.146833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:12.154547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 96/200] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:11 2022] GET /identity/v3/role_assignments?user.id=bf533d414187425ea006e350f6b6f292&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 610 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:12.161118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:12.227385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:12.230858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.234241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.235080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] PATH_INFO: `/v3/users/b5926c1b2c97406997192a3bb83e865a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.240456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] RBAC: Authorizing `identity:get_user(user_id=b5926c1b2c97406997192a3bb83e865a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:12.245878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:12.256235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 105/201] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:11 2022] GET /identity/v3/users/b5926c1b2c97406997192a3bb83e865a => generated 290 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:12.259010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:12.332932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.363328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.392094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80869ab6-2f8c-4b55-969c-87f5a1642da9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:12.453265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:12.454309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.454803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.455276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.456719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=8ed0fca87db44d5089e017f162a35d34) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:12.457155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:12.463537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:12.467212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 97/202] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:12 2022] GET /identity/v3/role_assignments?user.id=8ed0fca87db44d5089e017f162a35d34&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:12.467212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:12.477541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b541f5-8b73-4449-89f8-0c71c69dabb9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:12.553627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea860b3-49ec-4cba-ad73-7df447aa5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:12.554758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea860b3-49ec-4cba-ad73-7df447aa5392 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.555316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea860b3-49ec-4cba-ad73-7df447aa5392 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.555827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea860b3-49ec-4cba-ad73-7df447aa5392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.590661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d3bb0-d11c-419a-bdc6-cea6b9ced2a5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:12.635909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.644519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74f000-ea06-42df-92e6-d2c2880107be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:12.645506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74f000-ea06-42df-92e6-d2c2880107be None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.645941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74f000-ea06-42df-92e6-d2c2880107be None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.646716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74f000-ea06-42df-92e6-d2c2880107be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.664903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea860b3-49ec-4cba-ad73-7df447aa5392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:12.667003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea860b3-49ec-4cba-ad73-7df447aa5392 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:12.718899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.768865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74f000-ea06-42df-92e6-d2c2880107be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:12.770987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74f000-ea06-42df-92e6-d2c2880107be None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 106/203] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ffa78-d512-4191-8850-459fbdb69480 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ffa78-d512-4191-8850-459fbdb69480 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ffa78-d512-4191-8850-459fbdb69480 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 107/204] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeee48-dd5b-4d37-a72b-952b4e6d5bee None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.832753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeee48-dd5b-4d37-a72b-952b4e6d5bee None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.833687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeee48-dd5b-4d37-a72b-952b4e6d5bee None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.836200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 108/205] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:12.836619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeee48-dd5b-4d37-a72b-952b4e6d5bee None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:12.930792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 98/206] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:12.930792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a23bd-8795-48b0-ace1-ed095cb5925d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.930792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a23bd-8795-48b0-ace1-ed095cb5925d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.930792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a23bd-8795-48b0-ace1-ed095cb5925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.950406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aa0a23bd-8795-48b0-ace1-ed095cb5925d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:12.952014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aa0a23bd-8795-48b0-ace1-ed095cb5925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:13.003449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:13.044075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeee48-dd5b-4d37-a72b-952b4e6d5bee None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:13.079221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 99/207] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:13.080791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:13.081800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:13.082262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:13.097347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:13.106434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:13.107672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:13.108371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:13.109148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:13.110610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:13.112441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:13.114447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 109/208] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:12 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:13.115516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:13.119250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:13.128420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:13.253760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 100/209] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:13.255113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:13.324813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccb211-35dd-4133-a62e-77013d9c564a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:13.390257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:13.390905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:13.391188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:13.391465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:13.392701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:13.394209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:13.396242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 110/210] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:13 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:13.397665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:13.417988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:13.433215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7027-6adf-4677-ac76-c1aca8b5a25e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:13.482419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:13.483342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:13.484661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:13.484942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:13.485376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:13.486261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] RBAC: Adding query filter params (role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=8ed0fca87db44d5089e017f162a35d34) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:13.486574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:13.489088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:13.497426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 101/211] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:13 2022] GET /identity/v3/role_assignments?user.id=8ed0fca87db44d5089e017f162a35d34&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:13.499128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:13.550619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b70fd-5d42-4610-8956-7e2075b947c5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:13.669737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:13.670858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:13.671355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:13.671489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f01fd-c149-440a-b87e-1c4ee3bcb25e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:13.671914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:13.674690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:13.677849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:13.682429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 111/212] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:13.684022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:13.730345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:13.730978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:13.731258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:13.731700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:13.733004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] RBAC: Adding query filter params (role.id=c8c42f018e22458b869c2546bd5be59a, scope.project.id=95e27803c0c0485da5f8d29ddcc12933, user.id=b5926c1b2c97406997192a3bb83e865a) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:13.733313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:13.736345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:13.746978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 102/213] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:13 2022] GET /identity/v3/role_assignments?user.id=b5926c1b2c97406997192a3bb83e865a&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=c8c42f018e22458b869c2546bd5be59a => generated 610 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:13.747445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:13.810361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:13.965791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9c8a-ec42-42d1-b24c-3df9f623e643 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:14.005682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bb28c-33a0-44bd-ba9b-2a2555139c20 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:14.043204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:14.043862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:14.044140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:14.044435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:14.049410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:14.059369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:14.064597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:14.064597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:14.064776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:14.064870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:14.064870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:14.065854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:14.066574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:14.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:14.068269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 112/214] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:14.077034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:14.173160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 103/215] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:13 2022] POST /identity/v3/users => generated 298 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:14.242284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691632-f81d-49bb-a31c-718de51266a8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:14.290974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:14.291867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:14.292278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:14.292559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:14.293371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:14.293760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:14.295197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:14.307633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 113/216] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:14.313777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:14.417137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:14.459064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3225-425b-4744-a44a-24f381934487 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:14.508843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:14.509487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:14.509846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:14.510130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] PATH_INFO: `/v3/users/09eecaf5b4fb46a9b2ebfcab1f712d94` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:14.530418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] RBAC: Authorizing `identity:get_user(user_id=09eecaf5b4fb46a9b2ebfcab1f712d94)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:14.532217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:14.534796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 104/217] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:14 2022] GET /identity/v3/users/09eecaf5b4fb46a9b2ebfcab1f712d94 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:14.540688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:14.624327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:14.690328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166343-56c7-4701-9d65-57d5fc461a86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:14.744765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f61c55-682b-4283-b84c-7a76bc7e22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:14.745514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f61c55-682b-4283-b84c-7a76bc7e22ba None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:14.745799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f61c55-682b-4283-b84c-7a76bc7e22ba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:14.746072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f61c55-682b-4283-b84c-7a76bc7e22ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:14.861461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f61c55-682b-4283-b84c-7a76bc7e22ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:14.862962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f61c55-682b-4283-b84c-7a76bc7e22ba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:14.945845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:15.004019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 114/218] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:15.013231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:15.197180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1234ad-b5e7-4f10-b374-ecc9233048c0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:15.209741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30dd65-89a0-4bea-836b-8e96f20d19b5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.209741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30dd65-89a0-4bea-836b-8e96f20d19b5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.210083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30dd65-89a0-4bea-836b-8e96f20d19b5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.212325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 115/219] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:44:15.218525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88602a4-53c7-481d-860b-927fc250847f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.218811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88602a4-53c7-481d-860b-927fc250847f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.219072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88602a4-53c7-481d-860b-927fc250847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.237530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:15.241731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d88602a4-53c7-481d-860b-927fc250847f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:15.242624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:15.242941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d88602a4-53c7-481d-860b-927fc250847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:15.243409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.243756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.244093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.245582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:15.247350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:15.249308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 105/220] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:15 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:15.256075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:15.335377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 116/221] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:15.442584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfbcb0-09f7-40d1-9c73-778a9e25fa5d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:15.486940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:15.487476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.487750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.488019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.488783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=09eecaf5b4fb46a9b2ebfcab1f712d94) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:15.489088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:15.491165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:15.497859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 106/222] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:15 2022] GET /identity/v3/role_assignments?user.id=09eecaf5b4fb46a9b2ebfcab1f712d94&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:15.688048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88602a4-53c7-481d-860b-927fc250847f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:15.812834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:15.831238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88602a4-53c7-481d-860b-927fc250847f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:15.871922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734f011-d02f-4ba3-ad9c-edb60fba38ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:15.872591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734f011-d02f-4ba3-ad9c-edb60fba38ea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.872867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734f011-d02f-4ba3-ad9c-edb60fba38ea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.873137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734f011-d02f-4ba3-ad9c-edb60fba38ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.894046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734f011-d02f-4ba3-ad9c-edb60fba38ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5734f011-d02f-4ba3-ad9c-edb60fba38ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:15.899870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:15.900805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:15.902038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 117/223] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:15.907192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:15.920961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7a01-f3ab-4b93-96b2-0b8b3207a070 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.921152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7a01-f3ab-4b93-96b2-0b8b3207a070 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.922572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7a01-f3ab-4b93-96b2-0b8b3207a070 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.923073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 118/224] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:15.938091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:15.938851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:15.939594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:15.988938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:15.991480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:16.059705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:16.129640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60a35-ac15-4a19-b7cc-23345fe704fe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:16.143387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 119/225] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:16.172322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:16.172988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:16.173224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:16.173498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:16.174172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:16.174535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:16.175936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:16.185645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 107/226] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:16.191392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:16.356540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:16.391160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd3946-4b6c-49f7-a567-1d23cad01207 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:16.429340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:16.430338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:16.430821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:16.431297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] PATH_INFO: `/v3/users/8ed0fca87db44d5089e017f162a35d34` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:16.432726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed0fca87db44d5089e017f162a35d34)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:16.434476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:16.437845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 120/227] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:16 2022] GET /identity/v3/users/8ed0fca87db44d5089e017f162a35d34 => generated 284 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:16.444943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:16.638802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c2ee-f7f5-473e-945d-4756462e1323 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:16.681450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:16.689058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:16.691206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:16.691858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:16.692143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:16.692457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:16.694237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:16.695836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:16.697752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 108/228] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:16 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:16.715037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:16.915386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c88b1-7bc9-4925-bd1e-7f646c34df1d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:16.932853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1986c24-d3db-4082-9951-4fe9dda4a9f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:16.976431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06534dce-c1f5-41aa-b763-87bc6559f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:16.977114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06534dce-c1f5-41aa-b763-87bc6559f743 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:16.977393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06534dce-c1f5-41aa-b763-87bc6559f743 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:16.977667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06534dce-c1f5-41aa-b763-87bc6559f743 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/8ed0fca87db44d5089e017f162a35d34/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:16.979626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06534dce-c1f5-41aa-b763-87bc6559f743 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe564f2f17cc479ebe0094d3be82ce50, user_id=8ed0fca87db44d5089e017f162a35d34, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:16.981281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06534dce-c1f5-41aa-b763-87bc6559f743 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:17.002038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:17.002985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.003501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.003978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.023645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:17.032694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:17.034786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:17.036714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:17.041241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 121/229] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:17.048312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:17.060679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:17.066516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 109/230] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:16 2022] PUT /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/8ed0fca87db44d5089e017f162a35d34/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:17.270669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e3b19-e80f-4bbe-b1ff-61b4b915066b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:17.295485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50f839-1391-4d57-88d7-bdd2e41d29f2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.296472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50f839-1391-4d57-88d7-bdd2e41d29f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.297228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50f839-1391-4d57-88d7-bdd2e41d29f2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.300109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 110/231] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:17 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:17.307732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c40ab-9a54-49df-820d-bf5e0a54f812 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.308656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c40ab-9a54-49df-820d-bf5e0a54f812 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.309439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c40ab-9a54-49df-820d-bf5e0a54f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.347771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fb1c40ab-9a54-49df-820d-bf5e0a54f812 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:17.349017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fb1c40ab-9a54-49df-820d-bf5e0a54f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:17.360622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:17.361601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.362095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.362574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.363719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:17.364284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:17.367470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:17.384387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 122/232] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:17.392308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:17.462686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:17.474192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 111/233] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:17.476066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0da6e-f360-4ce9-b4e4-c5431ca818e7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.476386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0da6e-f360-4ce9-b4e4-c5431ca818e7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.476698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0da6e-f360-4ce9-b4e4-c5431ca818e7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.478104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 112/234] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:17.484293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.487617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.487617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.487894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:17.514256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:17.515750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:17.569907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a31c3a-4765-4314-b1e0-3b4822c85d46 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:17.639564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:17.640244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.640532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.640809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] PATH_INFO: `/v3/users/8ed0fca87db44d5089e017f162a35d34` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.643468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed0fca87db44d5089e017f162a35d34)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:17.645001 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:17.647634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 123/235] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:17 2022] GET /identity/v3/users/8ed0fca87db44d5089e017f162a35d34 => generated 284 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:17.652190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 113/236] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:17.659687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:17.814587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb59df-c59a-49fa-8dc1-01c062278570 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:17.864075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:17.864683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:17.865010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:17.865810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:17.867088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:17.868620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:17.870655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 124/237] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:17 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:17.876902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:17.891969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:17.895121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:18.048690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656fea6-140f-49e6-a744-fbaab236ae90 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:18.052261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a990f2-6a7a-4640-8a81-67bec0ad0292 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:18.074028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:18.088551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:18.089166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.089429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.089704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.090867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:18.092640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:18.100114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 125/238] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:18.100114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:18.113783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:18.115532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.116185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.116926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/8ed0fca87db44d5089e017f162a35d34/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.121363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=fe564f2f17cc479ebe0094d3be82ce50, user_id=8ed0fca87db44d5089e017f162a35d34, role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:18.124824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:18.175743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:18.210110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0fba4-219d-4b20-ab1f-f8439bb56c38 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:18.236483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 114/239] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:17 2022] PUT /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/8ed0fca87db44d5089e017f162a35d34/roles/6597e480361e45bbb37dc41cff9e4582 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:18.238081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:18.259544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:18.261322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.262186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.263393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.279873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:18.288774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:18.289783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:18.290575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:18.294071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 126/240] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:18.303827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:18.440758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725479-1c22-41c0-aa85-6f6d92b8e7b3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:18.446452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a49766-238b-4f3f-8fad-339ab1231b9c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:18.487008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:18.494226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:18.494850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.495155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.495646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.496381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:18.496685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:18.498352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb9e5-d524-41ea-9e9e-2baee6f2e7e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:18.506720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26beef4-9221-4fc2-8d61-c7eb8939e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:18.509236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26beef4-9221-4fc2-8d61-c7eb8939e505 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.509236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26beef4-9221-4fc2-8d61-c7eb8939e505 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.509236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26beef4-9221-4fc2-8d61-c7eb8939e505 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.509236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26beef4-9221-4fc2-8d61-c7eb8939e505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:18.510308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26beef4-9221-4fc2-8d61-c7eb8939e505 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:18.510655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 127/241] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:18 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:18.512248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625623-9e7e-4d14-a7fc-4f1ae446da14 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.512666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625623-9e7e-4d14-a7fc-4f1ae446da14 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.512947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625623-9e7e-4d14-a7fc-4f1ae446da14 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.514343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 128/242] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:18.518509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625623-9e7e-4d14-a7fc-4f1ae446da14 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:18.635457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 115/243] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:18 2022] POST /identity/v3/users => generated 294 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:18.636921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625623-9e7e-4d14-a7fc-4f1ae446da14 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:18.637922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.638420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.638902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.674445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:18.677109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:18.726856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:18.733055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:18.733738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:18.734025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:18.734304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] PATH_INFO: `/v3/users/6ef831f9c01343a68f2c95a25ee3956d` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:18.768385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] RBAC: Authorizing `identity:get_user(user_id=6ef831f9c01343a68f2c95a25ee3956d)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:18.769911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:18.772529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 129/244] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:18 2022] GET /identity/v3/users/6ef831f9c01343a68f2c95a25ee3956d => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:18.779001 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:18.816652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 116/245] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:18.867136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:18.960406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738926ef-c9d2-4d72-8aa4-fb2174783d3f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:19.002053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:19.002743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.003028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.003305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.087577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:19.089125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:19.160577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:19.217437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 130/246] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:19.226735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:19.239244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:19.370872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63f128-bc7b-4675-b6ea-1278804497c0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:19.403574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c258c-0c55-4952-a8f7-ab0c83e15bf2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:19.411192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:19.412553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.413024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.413301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.426161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:19.431031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:19.433245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:19.435198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 131/247] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:19.446734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:19.452444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:19.453101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.453384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.453662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.454855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:19.456352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:19.458915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 117/248] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:19 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:19.462156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:19.465301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:19.497927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:19.571184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ad351-c4a1-45c3-8428-6ecfa95a000f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:19.599153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9f28-5f54-4804-a9a0-75af0a29eec2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:19.612472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:19.613449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.614060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.614612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.615764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:19.616187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:19.617818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4d10d-fb95-4dc2-8784-d8d21ab7169a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:19.628121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 132/249] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:19.629637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467d67-bd01-4d95-9830-3eef00966934 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.630000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467d67-bd01-4d95-9830-3eef00966934 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.630500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467d67-bd01-4d95-9830-3eef00966934 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.632545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 133/250] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:19.633396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467d67-bd01-4d95-9830-3eef00966934 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:19.649547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:19.653549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.653549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.653549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.653549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] RBAC: Adding query filter params (role.id=c8c42f018e22458b869c2546bd5be59a, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=6ef831f9c01343a68f2c95a25ee3956d) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:19.653549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:19.654875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9367b-6ec2-4cea-9abf-fb16a1b9272e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:19.668852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 118/251] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:19 2022] GET /identity/v3/role_assignments?user.id=6ef831f9c01343a68f2c95a25ee3956d&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=c8c42f018e22458b869c2546bd5be59a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:19.670901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.671514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.672072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.703597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:19.705521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:19.836758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 119/252] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:19.860576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:19.905923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467d67-bd01-4d95-9830-3eef00966934 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:19.969739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:19.970398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:19.970678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:19.970956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] PATH_INFO: `/v3/users/09eecaf5b4fb46a9b2ebfcab1f712d94` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:19.973114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] RBAC: Authorizing `identity:get_user(user_id=09eecaf5b4fb46a9b2ebfcab1f712d94)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:19.975782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:19.977866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 134/253] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:19 2022] GET /identity/v3/users/09eecaf5b4fb46a9b2ebfcab1f712d94 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:19.983602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:20.022626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:20.131252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c3a7b-de57-461c-9797-8712f5e3e9c5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:20.180358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:20.181021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:20.181303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:20.181578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:20.182789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:20.184324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:20.186352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 120/254] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:19 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:20.196352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:20.422256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e725f-2c8d-4891-affd-7bd50ca03303 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:20.483379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:20.484515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:20.485004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:20.485480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/09eecaf5b4fb46a9b2ebfcab1f712d94/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:20.488744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe564f2f17cc479ebe0094d3be82ce50, user_id=09eecaf5b4fb46a9b2ebfcab1f712d94, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:20.491816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:20.524047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:20.565301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:20.577076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 135/255] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:20 2022] PUT /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/09eecaf5b4fb46a9b2ebfcab1f712d94/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:20.660745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:20.672522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f77156-dd28-4ce0-b92c-a0325dbe83dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:20.715013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:20.715662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:20.715942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:20.716305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:20.729154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:20.734206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:20.737512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:20.740635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 121/256] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:20.743132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:20.917666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c592de-dd88-4400-a48b-dc61a74d8f7d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:20.964794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:20.965345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:20.965627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:20.965899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:20.966574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:20.966877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:20.968300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f03da-cbfa-4ae8-8b08-e7d17cf27a08 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:20.979787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 136/257] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:20.985410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:21.127496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673087-a65a-442e-83ab-4ee35f1d3686 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:21.166159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167e94d-8796-4be9-ab77-993e5297b581 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:21.166478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167e94d-8796-4be9-ab77-993e5297b581 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:21.166717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167e94d-8796-4be9-ab77-993e5297b581 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:21.168294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 137/258] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:44:21.178125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:21.178425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:21.178705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:21.203148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:21.203824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:21.204107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:21.204496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] PATH_INFO: `/v3/users/8ed0fca87db44d5089e017f162a35d34` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:21.205949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] RBAC: Authorizing `identity:get_user(user_id=8ed0fca87db44d5089e017f162a35d34)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:21.210548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:21.214886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 122/259] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:20 2022] GET /identity/v3/users/8ed0fca87db44d5089e017f162a35d34 => generated 284 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:21.215983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:21.217282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:21.225589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:21.287364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:21.335404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:21.343181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 138/260] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:21.476231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368d822-f4e5-4208-8bbf-4657bb98965a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:21.539220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:21.540239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:21.540732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:21.541222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:21.688417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:21.717840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:21.720099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:21.782673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:21.813533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c82ed-f21f-4028-bde5-48af2bdd52cd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:21.856597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:21.857246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:21.857528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:21.857804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:21.872376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:21.877846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:21.880576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:21.883054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 139/261] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:21.888192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:21.956881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:22.015507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f72313-474f-4a75-8cb8-9d3ce940be2a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:22.073819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 123/262] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 848 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:22.078282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:22.079277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:22.080221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.080697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.081161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.088188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:22.088188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:22.088188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:22.102618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 140/263] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:22.111675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:22.296554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94821f-93c6-4906-83f9-7a9bae1c87f5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:22.320820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:22.365722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb76461-f9ca-4a0b-98c9-38e92a24fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:22.366294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb76461-f9ca-4a0b-98c9-38e92a24fc97 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.366587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb76461-f9ca-4a0b-98c9-38e92a24fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.366869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb76461-f9ca-4a0b-98c9-38e92a24fc97 None admin] PATH_INFO: `/v3/users/8ed0fca87db44d5089e017f162a35d34` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.368557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb76461-f9ca-4a0b-98c9-38e92a24fc97 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed0fca87db44d5089e017f162a35d34)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:22.370717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb76461-f9ca-4a0b-98c9-38e92a24fc97 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:22.372815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 141/264] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:22 2022] GET /identity/v3/users/8ed0fca87db44d5089e017f162a35d34 => generated 284 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:22.374106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7477e-1a22-4dba-92d9-a514cbc4e006 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.381022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7477e-1a22-4dba-92d9-a514cbc4e006 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.381310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7477e-1a22-4dba-92d9-a514cbc4e006 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.383504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 142/265] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:22 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:22.384504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7477e-1a22-4dba-92d9-a514cbc4e006 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:22.434189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1b148-98bb-4f5f-ade0-97cd31f82126 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:22.497993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:22.569856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7477e-1a22-4dba-92d9-a514cbc4e006 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:22.589033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33c7d9-1bfc-4f47-ac4f-29cec8fd95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:22.589751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33c7d9-1bfc-4f47-ac4f-29cec8fd95b1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.590074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33c7d9-1bfc-4f47-ac4f-29cec8fd95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.590310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33c7d9-1bfc-4f47-ac4f-29cec8fd95b1 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.597145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33c7d9-1bfc-4f47-ac4f-29cec8fd95b1 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:22.599470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33c7d9-1bfc-4f47-ac4f-29cec8fd95b1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:22.602037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 124/266] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:22 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:22.603529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.603806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.604085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.661604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602023a-5ef7-485f-b841-9d58d41c787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:22.662226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602023a-5ef7-485f-b841-9d58d41c787c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.662526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602023a-5ef7-485f-b841-9d58d41c787c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.662780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602023a-5ef7-485f-b841-9d58d41c787c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.663240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:22.664706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:22.735925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:22.758890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602023a-5ef7-485f-b841-9d58d41c787c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:22.760757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602023a-5ef7-485f-b841-9d58d41c787c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:22.775832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 125/267] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:22.776885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:22.891599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 143/268] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:22.893410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53021-995a-4a55-b86d-e69f5185a111 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.893698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53021-995a-4a55-b86d-e69f5185a111 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.893968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53021-995a-4a55-b86d-e69f5185a111 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.896232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 144/269] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:22.904332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd2861-c5f4-41c7-9aec-7017943a2d02 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.904627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd2861-c5f4-41c7-9aec-7017943a2d02 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.904869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd2861-c5f4-41c7-9aec-7017943a2d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.937482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85921a-0400-43b3-b0e6-8878800bcdfc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:22.942431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a8dd2861-c5f4-41c7-9aec-7017943a2d02 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:22.943641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a8dd2861-c5f4-41c7-9aec-7017943a2d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:22.959989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:22.984781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:22.985422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:22.985763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:22.986032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:22.986756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=8ed0fca87db44d5089e017f162a35d34) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:22.987059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:22.988621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:22.997478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 126/270] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:22 2022] GET /identity/v3/role_assignments?user.id=8ed0fca87db44d5089e017f162a35d34&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:22.998347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.034277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 145/271] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:23.036835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48aa39-4a8c-453a-b214-5e274cf89351 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.037537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48aa39-4a8c-453a-b214-5e274cf89351 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.038320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48aa39-4a8c-453a-b214-5e274cf89351 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.041012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 146/272] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:23 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:23.047356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.048402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.048875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.079063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:23.086400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:23.100271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:23.181255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 147/273] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:23.215098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade43c7c-6393-44d0-ba9e-eaba89c1cb9f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:23.264762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.267930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:23.268670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.269015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.269396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.271253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:23.273160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:23.275319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 127/274] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:22 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:23.284267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.362328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:23.468370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b760e-714f-4ade-978d-351b2fccc4f0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:23.489658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b409eb-b0fd-4f7b-b411-ab1f27e2de35 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:23.524272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:23.525278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.526169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.526617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.527672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] RBAC: Adding query filter params (role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=8ed0fca87db44d5089e017f162a35d34) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:23.528277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:23.529920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:23.538687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 128/275] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:23 2022] GET /identity/v3/role_assignments?user.id=8ed0fca87db44d5089e017f162a35d34&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 610 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:23.539806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.588328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:23.589834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.590319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.590790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.613494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:23.618834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:23.619763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:23.620578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:23.623041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 148/276] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:23.624261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.630016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:23.722748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc267f-e4a8-4ba5-b063-a74e49b9f106 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:23.743100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:23.785004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:23.785715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.786526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.786832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.788487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:23.792727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:23.796596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 129/277] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:23.797684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.831664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ecc64-1bc3-4793-b397-62f2358387f7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:23.870696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:23.871330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.871606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.871873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.884648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:23.889917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:23.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 149/278] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:23.891902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:23.936842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa741-64da-40f1-8ecb-7a7815847bde None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:23.971159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:23.971775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:23.972051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:23.972346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:23.973139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:23.973864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:23.974038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:23.975226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:23.983848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 130/279] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:23.985182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.018877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16990f99-d2d7-49dc-a301-f149f8d4bac6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.031141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:24.057181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.057798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.058073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.058347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.058993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.060572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.098002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4ac6-2f04-4134-9b74-cfcff7a126f9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.133891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.134503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.134780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.135049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.135711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:24.136020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.137439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.146672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 131/280] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:24.150380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.177317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 150/281] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:23 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:24.177317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.322334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b3958-2f82-438c-9bfd-8723412d5226 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.326787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:24.352321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9db7c-f9b5-47be-885a-f5d286b99d6e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.378573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:24.386196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce2c0-900d-4114-91ca-771e02dfbdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.386955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce2c0-900d-4114-91ca-771e02dfbdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.387403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce2c0-900d-4114-91ca-771e02dfbdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.387716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce2c0-900d-4114-91ca-771e02dfbdc7 None admin] PATH_INFO: `/v3/users/68fe715de615475b8357a6d54859364a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.402023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ab9ba-ec4f-4ce3-94a6-8dc1142a2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.402666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ab9ba-ec4f-4ce3-94a6-8dc1142a2b77 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.402946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ab9ba-ec4f-4ce3-94a6-8dc1142a2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.403229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ab9ba-ec4f-4ce3-94a6-8dc1142a2b77 None admin] PATH_INFO: `/v3/users/6ef831f9c01343a68f2c95a25ee3956d` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.404428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ab9ba-ec4f-4ce3-94a6-8dc1142a2b77 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef831f9c01343a68f2c95a25ee3956d)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.406632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ab9ba-ec4f-4ce3-94a6-8dc1142a2b77 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.407649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 151/282] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:24 2022] GET /identity/v3/users/6ef831f9c01343a68f2c95a25ee3956d => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:24.408917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fb402-c083-42aa-a896-b288181c5589 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.409201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fb402-c083-42aa-a896-b288181c5589 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.409475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fb402-c083-42aa-a896-b288181c5589 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.410989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 152/283] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:24.415789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bce2c0-900d-4114-91ca-771e02dfbdc7 None admin] RBAC: Authorizing `identity:get_user(user_id=68fe715de615475b8357a6d54859364a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.416011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fb402-c083-42aa-a896-b288181c5589 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.418592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bce2c0-900d-4114-91ca-771e02dfbdc7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.422072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 132/284] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:24 2022] GET /identity/v3/users/68fe715de615475b8357a6d54859364a => generated 294 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:24.424115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.424640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.425052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.456350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:24.458186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:24.559077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 133/285] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:24.560553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.579348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fb402-c083-42aa-a896-b288181c5589 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.638608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.639257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.639542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.639820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.641308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.642781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.646587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 153/286] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:24 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:24.653291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.734075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:24.734543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:24.751469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5182e-da52-45fe-894b-46f3778f2a76 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.793748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5cf4-d6c6-4cd2-9966-56eea46ee910 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:24.817671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.819051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.819711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.821113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.823124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, user.id=68fe715de615475b8357a6d54859364a, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:24.824039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.828548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.838818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:24.839585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:24.839972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:24.840559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/6ef831f9c01343a68f2c95a25ee3956d/roles/c8c42f018e22458b869c2546bd5be59a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:24.841430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 134/287] 10.222.0.122 () {56 vars in 1313 bytes} [Fri Aug 26 00:44:24 2022] GET /identity/v3/role_assignments?user.id=68fe715de615475b8357a6d54859364a&scope.system=all&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 227 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:24.843288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe564f2f17cc479ebe0094d3be82ce50, user_id=6ef831f9c01343a68f2c95a25ee3956d, role_id=c8c42f018e22458b869c2546bd5be59a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:24.848960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:24.880748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:24.921821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 154/288] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:44:24 2022] PUT /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/users/6ef831f9c01343a68f2c95a25ee3956d/roles/c8c42f018e22458b869c2546bd5be59a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:25.063347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec67f3-413c-4502-b311-9743ed8e9e22 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:25.110209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:25.111139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:25.111572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:25.112000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:25.130217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:25.135669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:25.136805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:25.137702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:25.139692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 135/289] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:25.146934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:25.322997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eb6ff-22ab-4cda-8247-8dd789da4ac7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:25.361151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:25.400679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:25.401726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:25.402201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:25.402654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:25.403969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:25.408911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:25.412764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:25.437836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 155/290] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:25.446653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:25.492697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:25.595519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a65a-8809-4bac-8803-f26e2be61737 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:25.652568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:25.653540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:25.654012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:25.654646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] PATH_INFO: `/v3/users/09eecaf5b4fb46a9b2ebfcab1f712d94` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:25.656818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] RBAC: Authorizing `identity:get_user(user_id=09eecaf5b4fb46a9b2ebfcab1f712d94)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:25.660976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:25.662592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 136/291] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:25 2022] GET /identity/v3/users/09eecaf5b4fb46a9b2ebfcab1f712d94 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:25.671619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:25.932552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff5560-49cb-4314-b859-b817a0d2dbc8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:26.063044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:26.064057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:26.064555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:26.065019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:26.175324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:26.212972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:26.215663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:26.435103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 156/292] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:26.443545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:26.667549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:26.713697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb670f-569b-4ffc-9a8a-4f6665d81b2e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:26.767295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee20e8-9191-4048-90a3-ef765c4d84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:26.767958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee20e8-9191-4048-90a3-ef765c4d84f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:26.768264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee20e8-9191-4048-90a3-ef765c4d84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:26.768543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee20e8-9191-4048-90a3-ef765c4d84f8 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:26.769979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee20e8-9191-4048-90a3-ef765c4d84f8 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:26.771930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee20e8-9191-4048-90a3-ef765c4d84f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:26.773955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 137/293] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:26 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:26.783239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:26.914323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:26.948886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6048a39-5551-4ec8-953c-66dbdecfe445 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:26.997746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:26.998365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:26.998642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:26.998908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:26.999651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=09eecaf5b4fb46a9b2ebfcab1f712d94) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:27.000225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:27.001890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e3983-723c-4263-a39b-d3be673277fe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:27.013565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 157/294] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:26 2022] GET /identity/v3/role_assignments?user.id=09eecaf5b4fb46a9b2ebfcab1f712d94&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 610 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:27.344083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635d1c-389e-425e-834a-e063918448ec None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:27.344613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635d1c-389e-425e-834a-e063918448ec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:27.345081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635d1c-389e-425e-834a-e063918448ec None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:27.349317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 138/295] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:27 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:27.358741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a81d-0e34-4f9e-840c-3c14d3ff582c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:27.359636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a81d-0e34-4f9e-840c-3c14d3ff582c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:27.360422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a81d-0e34-4f9e-840c-3c14d3ff582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:27.391732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-95b6a81d-0e34-4f9e-840c-3c14d3ff582c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:27.393308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-95b6a81d-0e34-4f9e-840c-3c14d3ff582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:27.490083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 158/296] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:27.792864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635d1c-389e-425e-834a-e063918448ec None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:27.924915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635d1c-389e-425e-834a-e063918448ec None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:27.943329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b54bb-bbbd-44d5-965e-1e46999e3283 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:27.944433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b54bb-bbbd-44d5-965e-1e46999e3283 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:27.944977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b54bb-bbbd-44d5-965e-1e46999e3283 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:27.947120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 159/297] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:27 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:27.954035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed5d7-4669-4d4e-86d3-41052a8c9205 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:27.954669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed5d7-4669-4d4e-86d3-41052a8c9205 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:27.955217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed5d7-4669-4d4e-86d3-41052a8c9205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:27.970202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:27.970775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:27.971053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:27.971324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:27.978376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9b0ed5d7-4669-4d4e-86d3-41052a8c9205 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:27.980181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9b0ed5d7-4669-4d4e-86d3-41052a8c9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:27.992226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:27.993094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:27.993913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 139/298] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:28.011238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:28.028734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:28.099253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:28.110665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 160/299] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:28.132346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc1f8-36b1-4cff-a3c5-bad108d1c20f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:28.155178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895498-7983-48b0-99a4-2fdb40af9464 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.155449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895498-7983-48b0-99a4-2fdb40af9464 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.156041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895498-7983-48b0-99a4-2fdb40af9464 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.158502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 161/300] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:28.165410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a063df-4b63-4de4-9c39-3efd9c2cc410 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.166213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a063df-4b63-4de4-9c39-3efd9c2cc410 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.166680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a063df-4b63-4de4-9c39-3efd9c2cc410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.187114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:28.188610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.189658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.190349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.192061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:28.192784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:28.194885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-05a063df-4b63-4de4-9c39-3efd9c2cc410 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:28.195430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:28.197371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-05a063df-4b63-4de4-9c39-3efd9c2cc410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:28.212847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 140/301] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:28.223292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:28.296655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 162/302] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:28.298256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f29d4-18c9-4452-8688-581b9a18cc40 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.298606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f29d4-18c9-4452-8688-581b9a18cc40 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.298998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f29d4-18c9-4452-8688-581b9a18cc40 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.300215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 163/303] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:28.308065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.308655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.309068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.334799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:28.336292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:28.356472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:28.388087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5439aee-a300-4a57-a244-8e9af5829191 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:28.426386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:28.427040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.427321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.427597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] PATH_INFO: `/v3/users/778d4846a2ec440ebea2940f38891b7e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.447833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] RBAC: Authorizing `identity:get_user(user_id=778d4846a2ec440ebea2940f38891b7e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:28.450127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:28.452431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 141/304] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/users/778d4846a2ec440ebea2940f38891b7e => generated 294 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:28.460274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 164/305] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:28.466214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:28.511891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:28.619123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:28.670810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4dc30-47f5-4ada-90bd-43d6b1f64d7b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:28.671081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7308d-7419-4e2e-bb40-0ca688ab6495 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:28.712668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:28.713697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.714257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.714532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.720349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:28.727478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:28.727746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:28.728382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.728844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.729138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.730039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] RBAC: Adding query filter params (role.id=c8c42f018e22458b869c2546bd5be59a, user.id=778d4846a2ec440ebea2940f38891b7e, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:28.730475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:28.731938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:28.732334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:28.748672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 165/306] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:28.751247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:28.755242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 142/307] 10.222.0.122 () {56 vars in 1313 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/role_assignments?user.id=778d4846a2ec440ebea2940f38891b7e&scope.system=all&role.id=c8c42f018e22458b869c2546bd5be59a => generated 227 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:28.755242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:28.908699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e030ba-77f3-4586-8255-be38b0c59b99 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:28.936332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:28.948863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31b478-c12a-4c2a-96bc-10fd6ced3886 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:28.951694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:28.952369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:28.952650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:28.952926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:28.954102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:28.955569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:28.958290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 166/308] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:28.959147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.014103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.015107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.015590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.016065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.016995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:29.017506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:29.019215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:29.029106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 143/309] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:29.030280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.106377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:29.131739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf5694-9ddf-4510-9af4-8958ffc423a8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:29.175268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807a3c-081d-4239-a92c-3a336028095f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:29.184084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.185216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.185710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.186200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.205943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:29.217834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:29.218777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:29.219559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:29.220179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 167/310] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:29.220493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.221283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.221700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.222106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] PATH_INFO: `/v3/groups` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.223837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:29.225320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.225646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:29.306282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 144/311] 10.222.0.122 () {60 vars in 1139 bytes} [Fri Aug 26 00:44:29 2022] POST /identity/v3/groups => generated 230 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:29.307601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.322326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:29.428057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3cf72-9fa1-4b0f-bdbe-fa98d4a35340 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:29.499244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.501065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.501590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc881-d9bd-41cb-a05e-1775b922005a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:29.502069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.502761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] PATH_INFO: `/v3/users/68fe715de615475b8357a6d54859364a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.506124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] RBAC: Authorizing `identity:get_user(user_id=68fe715de615475b8357a6d54859364a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:29.509134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:29.513170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 168/312] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:29 2022] GET /identity/v3/users/68fe715de615475b8357a6d54859364a => generated 294 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:29.518940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.539713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:29.582582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.583635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.584115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.584535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.589761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:29.589761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:29.589761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:29.604196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 145/313] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:29 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:29.608248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.760729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9635dc2-b9b5-4573-a0d3-21fca26a94f5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:29.761383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e343-dfd0-4ffa-b8db-a3948c1b2f10 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:29.785140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:29.809054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.810401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.810826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.812532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] PATH_INFO: `/v3/system/users/68fe715de615475b8357a6d54859364a/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.813347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=68fe715de615475b8357a6d54859364a, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:29.816579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:29.835872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:29.837479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:29.837479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:29.837877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] PATH_INFO: `/v3/users/6ef831f9c01343a68f2c95a25ee3956d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:29.839922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef831f9c01343a68f2c95a25ee3956d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:29.842472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:29.848213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 146/314] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:29 2022] GET /identity/v3/users/6ef831f9c01343a68f2c95a25ee3956d => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:29.852778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:29.915908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:29.924188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 169/315] 10.222.0.122 () {58 vars in 1339 bytes} [Fri Aug 26 00:44:29 2022] PUT /identity/v3/system/users/68fe715de615475b8357a6d54859364a/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:29.992620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feffa77-ec90-4131-b200-7215064adc74 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:30.054085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:30.055387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:30.055888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:30.056398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:30.157586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:30.159565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:30.216933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:30.287333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 147/316] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:30.292978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:30.482317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdbb04-9487-4698-833c-a79c660f744e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:30.549611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449a637-10da-4e5c-a301-6d3f7b4528a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:30.550664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449a637-10da-4e5c-a301-6d3f7b4528a7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:30.551131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449a637-10da-4e5c-a301-6d3f7b4528a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:30.551568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449a637-10da-4e5c-a301-6d3f7b4528a7 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:30.554327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449a637-10da-4e5c-a301-6d3f7b4528a7 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:30.556346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449a637-10da-4e5c-a301-6d3f7b4528a7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:30.559776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 170/317] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:30 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:30.565682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:30.717979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddad110-55cf-49d9-9214-a6f40213f45f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:30.781557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:30.782565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:30.783076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:30.783569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:30.787513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] RBAC: Adding query filter params (role.id=c8c42f018e22458b869c2546bd5be59a, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50, user.id=6ef831f9c01343a68f2c95a25ee3956d) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:30.787513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:30.788998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8d92a-762f-4629-b107-4e021ae92757 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:30.801833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 148/318] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:44:30 2022] GET /identity/v3/role_assignments?user.id=6ef831f9c01343a68f2c95a25ee3956d&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=c8c42f018e22458b869c2546bd5be59a => generated 610 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:30.816079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eca15-7a8a-4e81-b121-19f40bd172fa None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:30.817158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eca15-7a8a-4e81-b121-19f40bd172fa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:30.817650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eca15-7a8a-4e81-b121-19f40bd172fa None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:30.820265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 171/319] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:30 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:30.826176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:30.826503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:30.826725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:30.847044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:30.848343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:30.858578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:30.954978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 149/320] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:31.234468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eca15-7a8a-4e81-b121-19f40bd172fa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:31.309179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:31.406524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eca15-7a8a-4e81-b121-19f40bd172fa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:31.467932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:31.469037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:31.469533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:31.470015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:31.489286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:31.499232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:31.500985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:31.501825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:31.503131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 172/321] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:31.511117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:31.665253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043eb2a-4476-4324-ab93-89656f54d496 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:31.723901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:31.724849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:31.725133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:31.725409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:31.726123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:31.726655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:31.728303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ba54e-9652-44b8-a4b4-5670ea8676a3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:31.740814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 150/322] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:31 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:31.747641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:31.777168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ab6ff-635b-41cf-9111-14a684561d49 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:31.777512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ab6ff-635b-41cf-9111-14a684561d49 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:31.777745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ab6ff-635b-41cf-9111-14a684561d49 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:31.779462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 151/323] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:31.789625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:31.790120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:31.790603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:31.808888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:31.826060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:31.827277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:31.907380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 152/324] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:31.940118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3df004-6f5d-44e2-a731-0013cde9b96e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:31.959144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:31.999394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863f09-f4cb-426f-b6a1-4b1c77759261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:32.000220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863f09-f4cb-426f-b6a1-4b1c77759261 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.000555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863f09-f4cb-426f-b6a1-4b1c77759261 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.000828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863f09-f4cb-426f-b6a1-4b1c77759261 None admin] PATH_INFO: `/v3/users/778d4846a2ec440ebea2940f38891b7e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.002181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863f09-f4cb-426f-b6a1-4b1c77759261 None admin] RBAC: Authorizing `identity:get_user(user_id=778d4846a2ec440ebea2940f38891b7e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:32.003646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863f09-f4cb-426f-b6a1-4b1c77759261 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:32.006244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 173/325] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:31 2022] GET /identity/v3/users/778d4846a2ec440ebea2940f38891b7e => generated 294 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:32.011896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:32.154671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0aaf2-c64b-4434-bf98-aaccf90940ce None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.155164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0aaf2-c64b-4434-bf98-aaccf90940ce None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.155501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0aaf2-c64b-4434-bf98-aaccf90940ce None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.157879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 174/326] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:32.164727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.165124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.165273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.182436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b4d42-7f2d-4b5e-91e1-ca6c79351d2f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:32.193702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:32.195789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:32.226025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:32.226979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.227264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.227573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] PATH_INFO: `/v3/system/users/778d4846a2ec440ebea2940f38891b7e/roles/c8c42f018e22458b869c2546bd5be59a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.229405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=778d4846a2ec440ebea2940f38891b7e, role_id=c8c42f018e22458b869c2546bd5be59a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:32.231170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:32.233452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:32.270841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 175/327] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:32.271712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:32.303648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 153/328] 10.222.0.122 () {58 vars in 1339 bytes} [Fri Aug 26 00:44:32 2022] PUT /identity/v3/system/users/778d4846a2ec440ebea2940f38891b7e/roles/c8c42f018e22458b869c2546bd5be59a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:32.418011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458435a5-a791-46b6-a156-92e2e2986bbe None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:32.434788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:32.485701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:32.486427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.486788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.487061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.488316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:32.491285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:32.494027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 176/329] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:32.501650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:32.558480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:32.652863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2bdb3-246d-4695-99c1-33713990fa11 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:32.702796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:32.702796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.703095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5063-83a2-4895-babe-f20d62e682a8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:32.703170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.703170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] PATH_INFO: `/v3/groups` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.703551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:32.705048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:32.756875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:32.757492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.757766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.758033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.771948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:32.777941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:32.778921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:32.779773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 177/330] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:32.785840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:32.809811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 154/331] 10.222.0.122 () {60 vars in 1139 bytes} [Fri Aug 26 00:44:32 2022] POST /identity/v3/groups => generated 227 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:44:32.830248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:32.925034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b644fd1-c33b-4414-be87-332f57aca45f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:32.970621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:32.971223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:32.971505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:32.972191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:32.972475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:32.973643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:32.975536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:32.985988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 178/332] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:32.991900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:33.072049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:33.126582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0110fa-bb63-4518-8c11-204d814aa3de None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:33.188220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d9b6-7008-4e57-9b0c-aef7575c313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:33.189705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d9b6-7008-4e57-9b0c-aef7575c313f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:33.190393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d9b6-7008-4e57-9b0c-aef7575c313f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:33.191063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d9b6-7008-4e57-9b0c-aef7575c313f None admin] PATH_INFO: `/v3/users/68fe715de615475b8357a6d54859364a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:33.193904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d9b6-7008-4e57-9b0c-aef7575c313f None admin] RBAC: Authorizing `identity:get_user(user_id=68fe715de615475b8357a6d54859364a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:33.195791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d9b6-7008-4e57-9b0c-aef7575c313f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:33.198441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 155/333] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:32 2022] GET /identity/v3/users/68fe715de615475b8357a6d54859364a => generated 294 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:33.205324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:33.394153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:33.404853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a76c-726e-4538-8bd8-38b8d26a18dc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:33.465497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:33.466154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:33.466388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:33.466675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:33.467399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] RBAC: Adding query filter params (role.id=14eb7ac5d26b4fcea5d73f096f87415b, user.id=68fe715de615475b8357a6d54859364a, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:33.467705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:33.469210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16381d1e-b558-47a7-a22a-1baff12cb535 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:33.486917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 179/334] 10.222.0.122 () {56 vars in 1313 bytes} [Fri Aug 26 00:44:33 2022] GET /identity/v3/role_assignments?user.id=68fe715de615475b8357a6d54859364a&scope.system=all&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 512 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:34.429431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c033-7718-4f1a-84e1-791af46d3bc8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:34.429960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c033-7718-4f1a-84e1-791af46d3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:34.429960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c033-7718-4f1a-84e1-791af46d3bc8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:34.431515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 156/335] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:34.437423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b690e-ccdd-49ab-ad74-6985c5b4f4bb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:34.438002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b690e-ccdd-49ab-ad74-6985c5b4f4bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:34.438498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b690e-ccdd-49ab-ad74-6985c5b4f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:34.461435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a29b690e-ccdd-49ab-ad74-6985c5b4f4bb None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:34.462997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a29b690e-ccdd-49ab-ad74-6985c5b4f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:34.567535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 180/336] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:35.148115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c033-7718-4f1a-84e1-791af46d3bc8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.338197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e208544-4b1f-4964-b47c-de9924f4fb6a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.338557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e208544-4b1f-4964-b47c-de9924f4fb6a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.338750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e208544-4b1f-4964-b47c-de9924f4fb6a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.340773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 181/337] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:35.345609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.346466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.346753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.377261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c033-7718-4f1a-84e1-791af46d3bc8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.381439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:35.382708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:35.456248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:35.474975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 182/338] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:35.480896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.481563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.481846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.482123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.499680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:35.505332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:35.506245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:35.507027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 157/339] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:35.512920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.556786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:35.707946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48793685-366d-4bb6-9eb5-d1a6f1c2515f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.751811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.752504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.752786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.753060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.753736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:35.754753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.756497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.766287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 183/340] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:35 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:35.773357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.946037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7127-fa4c-494f-9f20-7409136e7637 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.999354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.999920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.000479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.000749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] PATH_INFO: `/v3/users/778d4846a2ec440ebea2940f38891b7e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.001958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] RBAC: Authorizing `identity:get_user(user_id=778d4846a2ec440ebea2940f38891b7e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.003428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.005722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 158/341] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:44:35 2022] GET /identity/v3/users/778d4846a2ec440ebea2940f38891b7e => generated 294 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:36.011658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.014115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.112004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.196080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.211228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569645-3f1c-428f-b898-14dda8ac3b14 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.246575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbf76a-25d9-46f4-affe-0982b1a49a0c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.281861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccc4d8-bbd0-4642-a231-f3c937978f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.282419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccc4d8-bbd0-4642-a231-f3c937978f83 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.282692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccc4d8-bbd0-4642-a231-f3c937978f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.282955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccc4d8-bbd0-4642-a231-f3c937978f83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.313590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccc4d8-bbd0-4642-a231-f3c937978f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7dccc4d8-bbd0-4642-a231-f3c937978f83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:36.319683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:36.321248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 159/342] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:36.322861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9c9d-dce3-484a-a287-8488e99cbf22 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.326091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9c9d-dce3-484a-a287-8488e99cbf22 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.326091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9c9d-dce3-484a-a287-8488e99cbf22 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.326091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 160/343] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:36 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:36.335120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d9c9d-dce3-484a-a287-8488e99cbf22 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.338118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.338731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.339008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.339291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.339992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] RBAC: Adding query filter params (role.id=c8c42f018e22458b869c2546bd5be59a, user.id=778d4846a2ec440ebea2940f38891b7e, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:36.340315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.341745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527141ba-35eb-4380-9d1d-15604fe82e71 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.371517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 184/344] 10.222.0.122 () {56 vars in 1313 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/role_assignments?user.id=778d4846a2ec440ebea2940f38891b7e&scope.system=all&role.id=c8c42f018e22458b869c2546bd5be59a => generated 512 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:36.372971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1547620-b4fa-4c72-8cb4-54b135efcffb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.373248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1547620-b4fa-4c72-8cb4-54b135efcffb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.373483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1547620-b4fa-4c72-8cb4-54b135efcffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.414294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c1547620-b4fa-4c72-8cb4-54b135efcffb None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:36.415720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c1547620-b4fa-4c72-8cb4-54b135efcffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:36.562220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d9c9d-dce3-484a-a287-8488e99cbf22 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.564999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 185/345] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:36.566431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afa4e-49eb-4063-8f2b-bfbe1b5f1e39 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.567202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afa4e-49eb-4063-8f2b-bfbe1b5f1e39 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.567503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afa4e-49eb-4063-8f2b-bfbe1b5f1e39 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.568911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 186/346] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:36.574493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.574839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.575080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.580458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.596458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:36.600204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:36.618975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.619601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.619875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.620179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.620849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:36.621143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.622567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.640698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 161/347] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:36.647178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.735416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.749088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 187/348] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:36.828487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf6b7-9cd2-4fcd-bd9f-4e8d86bcf641 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.874619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.875912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.876425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.876999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.937959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.981093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.982967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.022291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.136365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 162/349] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:37.146354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.247312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6322-9e63-4716-a088-f2f89c15eeae None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.292207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:37.307026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.308769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.309625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.310681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.321467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4f54-4770-449b-9a25-9af49fdd9c44 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.336421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:37.349020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:37.350749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:37.352243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:37.354468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 188/350] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:37.354767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.384414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.386502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.387234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.387934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.389993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.393042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.397380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 163/351] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:37.398617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.453957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:37.523943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe3f15-0276-4278-ad21-6ae3133a1560 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.546442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085eca-5e24-48a6-8a9e-9c911052b41d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.580308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.581627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.582354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.582867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.596338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.597137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.597277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.597657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.598268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:37.598798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.600681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.610406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:37.611485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 164/352] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:37.612219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:37.621540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:37.623359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:37.624872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:37.627461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:37.630846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 189/353] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:37.632039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.776646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152351ed-6bbf-47e6-bfce-5b1a302a07c8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.796560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ad34-3c6a-4017-b5b8-f2644fa5cdc9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.826285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:37.831536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.833070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.833253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.833504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.843641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.845897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.849661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 165/354] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:37.852358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.864726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f04ad-91fb-45a6-be1d-e2bbb207d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.865362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f04ad-91fb-45a6-be1d-e2bbb207d14d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.865647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f04ad-91fb-45a6-be1d-e2bbb207d14d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.865929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f04ad-91fb-45a6-be1d-e2bbb207d14d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.964625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:37.968275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f04ad-91fb-45a6-be1d-e2bbb207d14d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.970581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f04ad-91fb-45a6-be1d-e2bbb207d14d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.010322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519981-0ae9-4b1c-a13a-2acaf910fc30 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.059692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.060319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.060604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.060877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.061549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:38.061849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.063238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a194c-045d-4c58-be26-79ea42a8cbf1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.072975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 166/355] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:38.074060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5616-f3bb-4108-87c5-1ec7e462d336 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.074343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5616-f3bb-4108-87c5-1ec7e462d336 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.074616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5616-f3bb-4108-87c5-1ec7e462d336 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.075862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 167/356] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:38.080638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5616-f3bb-4108-87c5-1ec7e462d336 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.116618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 190/357] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:38.117827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea5db-55f3-4059-9d6d-389b15553e33 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.118042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea5db-55f3-4059-9d6d-389b15553e33 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.118258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea5db-55f3-4059-9d6d-389b15553e33 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.119619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 191/358] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:38.120807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.121085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.121668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.143404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:38.145188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:38.157346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.233786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5616-f3bb-4108-87c5-1ec7e462d336 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.252593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 192/359] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:38.257152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.283114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.295421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.300676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.300676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.300676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.300676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=95e27803c0c0485da5f8d29ddcc12933) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:38.300676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.300676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7347-4cc2-420d-ae74-8ce8af632ef1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.308785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 168/360] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 261 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:38.310239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.310598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.310930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.337099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:38.338459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:38.440576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c959-fdc1-40cc-82c6-32e56dfbabe8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.444661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 169/361] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:38.445924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.495350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.496680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.497293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.497768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.525113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.602549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.604785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.642919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22659d-2ad4-4e7a-b986-0c0793362f02 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.673247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.685111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.685757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.686033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.686303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.687544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.689171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.690874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 170/362] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:38.697471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.733851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 193/363] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:38.734841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.800821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.817858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38d3a-d54f-4598-bb31-6abf85ed536a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.863509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.863509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.863509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.863509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.877181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:38.882145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:38.883097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:38.884371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 171/364] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:38.885035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.896132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1efed-d8d2-445f-a8a5-4af148ac95cf None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.944262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.945382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.945814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.946242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.947566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.949366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.951489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 194/365] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:38.952582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.978738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.062290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bab827-3d0d-4983-8d9e-91aa7d406bb6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.111785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d3df-988f-41b1-b844-db4251a93405 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.125507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.125507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.126002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.126429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.129093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.131166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.135803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 172/366] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:39.135803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.142501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.169312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.170083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.170363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.170632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.190326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:39.195766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:39.196763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 195/367] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:39.197721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.305626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176b151-3146-49d6-bebf-13cffe28e63e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.344874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.361890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ccff-b791-46db-8b42-b31920cfcfb0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.370052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.370052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.370052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.370052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.372384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:39.372384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.372384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.381088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 173/368] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:39.382249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.417948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.418878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.419518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.420037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.421478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=95e27803c0c0485da5f8d29ddcc12933) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:39.422453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.424619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.439316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 196/369] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 261 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:39.440676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.503331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.541021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668006-f7ca-4da1-acf4-3843907dbbe6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.584841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.586027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.586452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.586965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.588440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.590367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.592636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 174/370] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:39.593283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a168-10fe-45e2-8700-944d7f9dc3e6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.594129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.637568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.638115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.638391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.638666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.639347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:39.639647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.641159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.654470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 197/371] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:39.655384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.677661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.754497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46556f-8388-43ae-b448-4661ae31aeca None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.807083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.808213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.808692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.809333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.813760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.819093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de2d5-bd41-4f42-89b7-18964199a14a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.855232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.855846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.856129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.856489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.857228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:39.857536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.859056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.866235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 198/372] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 261 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:39.866950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.901640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.903731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.967491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:39.991042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95736d8-04c1-4df6-aa4b-cb9d2db79a51 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.031555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 175/373] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:40.034318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.035284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.035850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.036129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.037617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:40.072772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:40.115243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.117958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.163479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63017-51fe-4e92-a5fb-3100080a8c71 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.203281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.204422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.204905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.205582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.207885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.210434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.213586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 176/374] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:40 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:40.218761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:40.232884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 199/375] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:40.238809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:40.247428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:40.335372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:40.353560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd9c1-56cf-4d19-8bdd-fe143e6a3b65 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.388364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab851-fa24-4a29-9981-c3be5303320b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.405585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.406244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.406516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.406814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.407945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.409518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.412449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 177/376] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:40 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:40.417991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:40.432483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.433542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.434019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.434483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] PATH_INFO: `/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.435997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] RBAC: Authorizing `identity:get_project(project_id=18e8867d5ccb4ae190c4e3acc02760b8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.437952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.440367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 200/377] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:40 2022] GET /identity/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8 => generated 345 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:40.449455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:40.575599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cc637-f218-4021-98e2-58deb8d73c23 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.601355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:40.607598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:40.615076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.615214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.615494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.615747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] PATH_INFO: `/v3/groups/240fc97faa43487f9cea94ce4c424969` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.617956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6b513-da32-4f6e-af77-d53fdb7c4e7c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.622387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] RBAC: Authorizing `identity:get_group(group_id=240fc97faa43487f9cea94ce4c424969)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.623876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.626230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 201/378] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:40 2022] GET /identity/v3/groups/240fc97faa43487f9cea94ce4c424969 => generated 230 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:40.633561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:40.687683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.688253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.688521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.688797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.689532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:40.689839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.691278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa846-9d7d-4810-8fd4-ffec3237b6b1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.698696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 178/379] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:40 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 261 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:40.766552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f645ec-2fe1-424a-9ac4-feb547bfa793 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:40.810978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:40.811643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.811884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.812179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.812934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] RBAC: Adding query filter params (group.id=240fc97faa43487f9cea94ce4c424969, role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=18e8867d5ccb4ae190c4e3acc02760b8) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:40.813250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:40.814802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21378e-2607-41e0-88b2-e2e0e2677908 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:40.822666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 202/380] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:40 2022] GET /identity/v3/role_assignments?group.id=240fc97faa43487f9cea94ce4c424969&scope.project.id=18e8867d5ccb4ae190c4e3acc02760b8&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 261 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:40.829052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d6d3-bf6f-4d5f-ba7e-fe08e15fa27d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.829368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d6d3-bf6f-4d5f-ba7e-fe08e15fa27d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.829609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d6d3-bf6f-4d5f-ba7e-fe08e15fa27d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.831051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 179/381] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:40.838317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:40.838633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:40.838881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:40.860116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:40.861394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:40.934212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:40.954346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 203/382] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:41.276955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357d6d3-bf6f-4d5f-ba7e-fe08e15fa27d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:41.396781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357d6d3-bf6f-4d5f-ba7e-fe08e15fa27d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:41.438700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:41.439579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:41.440056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:41.440506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:41.456530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:41.462487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:41.463547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:41.464550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:41.466862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 180/383] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:41.472896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:41.585598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338665bf-bb87-48a2-bd46-a8a24a46ba3a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:41.624470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:41.625625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:41.626044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:41.626520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:41.627327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:41.627791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:41.629874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:41.640502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 204/384] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:41.647990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:41.666354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:41.775718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dcf21-07a1-4677-a9f8-a7b208d4e98a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:41.823777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d904-71df-4c92-9e5e-bfc744d12eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:41.824447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d904-71df-4c92-9e5e-bfc744d12eeb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:41.824726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d904-71df-4c92-9e5e-bfc744d12eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:41.824997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d904-71df-4c92-9e5e-bfc744d12eeb None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:41.828809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d904-71df-4c92-9e5e-bfc744d12eeb None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:41.830265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d904-71df-4c92-9e5e-bfc744d12eeb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:41.831848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 181/385] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:41 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:41.838286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:41.910138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:41.918414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e84471-5ec5-43d9-b868-d7dec08c35dd None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:41.918711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e84471-5ec5-43d9-b868-d7dec08c35dd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:41.918972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e84471-5ec5-43d9-b868-d7dec08c35dd None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:41.920746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 182/386] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:41.925826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:41.926222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:41.926599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:41.965936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:41.967159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:42.014398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04951-ab83-4394-8c8a-0fa2caa4dd91 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:42.101054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:42.101633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.101917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.102196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.103380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:42.104888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:42.106707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 205/387] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:41 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:42.111932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 183/388] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:42.120270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:42.289123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d465eb-dded-4d64-9400-0cfd613b1156 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:42.311932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:42.334890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:42.335563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.335844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.336118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933/groups/fec4a685fe5d403988dbc89327fb91f7/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.338073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] RBAC: Authorizing `identity:create_grant(project_id=95e27803c0c0485da5f8d29ddcc12933, group_id=fec4a685fe5d403988dbc89327fb91f7, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:42.339538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:42.398716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 206/389] 10.222.0.122 () {58 vars in 1447 bytes} [Fri Aug 26 00:44:42 2022] PUT /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933/groups/fec4a685fe5d403988dbc89327fb91f7/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:42.453941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:42.467532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:42.588280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1e9bc-5509-4a37-b172-17f845527a92 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:42.625889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3516ebd-118e-4442-b171-224220a5a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:42.626521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516ebd-118e-4442-b171-224220a5a53e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.626805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516ebd-118e-4442-b171-224220a5a53e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.627076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516ebd-118e-4442-b171-224220a5a53e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.638793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3516ebd-118e-4442-b171-224220a5a53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f3516ebd-118e-4442-b171-224220a5a53e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:42.643567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:42.644480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:42.645319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:42.647426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 184/390] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:42.651416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:42.764848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266ca5b-eac7-4447-950f-f50c2cf340bc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:42.798161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6430-f6c3-457b-a3b4-645fd181b1f3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.798712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6430-f6c3-457b-a3b4-645fd181b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.798712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6430-f6c3-457b-a3b4-645fd181b1f3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.800171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 185/391] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:44:42.806240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.806526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.806802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.815866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:42.816054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.816322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.816505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.820663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:42.820974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:42.824695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:42.836015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:42.837279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:42.842643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 207/392] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:42 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:42.847582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:42.930223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:42.935798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:42.938353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 186/393] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:43.054043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049918-0963-4805-bbe6-a76259e89432 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.104899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.105897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.106389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.106877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.108253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.109923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.111717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 208/394] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:42 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:43.117393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.266385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca32293-0046-4373-8a0a-647ee29a61e1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.289012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.323448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.324423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.325079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.326514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.330576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.332243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.335101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 187/395] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:43 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:43.340977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.483003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:43.524120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8befb-b63e-4e73-9a3d-3a6fedae6967 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.534308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d2e2-9d2c-4a8a-9d35-6e4fbc74d4ba None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.547604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:43.565855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.566892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.567256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.567795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933/groups/fec4a685fe5d403988dbc89327fb91f7/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.570850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] RBAC: Authorizing `identity:create_grant(project_id=95e27803c0c0485da5f8d29ddcc12933, group_id=fec4a685fe5d403988dbc89327fb91f7, role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.572503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.578529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dcc25-cfe5-4668-9300-636c0b1219c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.579794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dcc25-cfe5-4668-9300-636c0b1219c3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.579794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dcc25-cfe5-4668-9300-636c0b1219c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.579963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dcc25-cfe5-4668-9300-636c0b1219c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.593412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dcc25-cfe5-4668-9300-636c0b1219c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ea0dcc25-cfe5-4668-9300-636c0b1219c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:43.599561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:43.600480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:43.601311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 209/396] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:43.601987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f222c-30d0-4dfb-b4d3-38d5082a9679 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.602316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f222c-30d0-4dfb-b4d3-38d5082a9679 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.602541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f222c-30d0-4dfb-b4d3-38d5082a9679 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.603910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 210/397] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:43.604997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f862-1cae-460b-8ea2-f361dfb9899e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.605260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f862-1cae-460b-8ea2-f361dfb9899e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.605461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f862-1cae-460b-8ea2-f361dfb9899e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.606761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 211/398] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:43 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:43.609168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2fa7d-bae0-4879-856c-dab90d098312 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.609667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2fa7d-bae0-4879-856c-dab90d098312 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.610136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2fa7d-bae0-4879-856c-dab90d098312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.630419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0bc2fa7d-bae0-4879-856c-dab90d098312 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:43.631881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0bc2fa7d-bae0-4879-856c-dab90d098312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:43.645120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 188/399] 10.222.0.122 () {58 vars in 1447 bytes} [Fri Aug 26 00:44:43 2022] PUT /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933/groups/fec4a685fe5d403988dbc89327fb91f7/roles/6597e480361e45bbb37dc41cff9e4582 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:43.645120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.719652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 212/400] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:43.721344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.721810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.722229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.743326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:43.744848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:43.804784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab4ee-530b-4046-8d5d-c32e79444ced None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.828721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 213/401] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:43.837216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:43.846768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.847566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.847851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.848880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.852843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:43.852843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.852843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.861382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 189/402] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:43.868284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.906815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.040405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab630d62-feed-46ba-8999-06c971665d36 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.102225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.103204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.103733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.104331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.106255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.109090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.112302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 214/403] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:43 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:44.118589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.181048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.282711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c631e-983c-4a19-b5c5-edc52944e618 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.314598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.321315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.321657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d974f2-b0b1-4ec4-b131-c7dca13b6523 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.322402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.323088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.323733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.325987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.328930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.339099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 190/404] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:44.339099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.362152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.363102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.364464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.364898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.377036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:44.383718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:44.385755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:44.387504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 215/405] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:44.396243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.456319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.503253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dd9e4-89ac-41d8-bf2c-b4115183181f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.530083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9991b9-bab7-4040-942a-ad2448b7bcbc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.542595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.543389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.543838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.544242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/groups/fec4a685fe5d403988dbc89327fb91f7/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.546438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe564f2f17cc479ebe0094d3be82ce50, group_id=fec4a685fe5d403988dbc89327fb91f7, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.548022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.592136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.592802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.593122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.593409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.606884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:44.611902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:44.618629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 191/406] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:44.619465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.670309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 216/407] 10.222.0.122 () {58 vars in 1447 bytes} [Fri Aug 26 00:44:44 2022] PUT /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/groups/fec4a685fe5d403988dbc89327fb91f7/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:44.672443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.704560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.765846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab55e2-8da6-4650-b240-61e9eff95584 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.819247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.821846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb058f-7d57-4f88-89b1-05b69851eaf0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.855410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.856095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.856506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.856759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.857378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:44.857681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.859207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87961a19-518a-49d9-8465-8c4c923b697b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.871606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 192/408] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:44.873324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459f67-ded4-427c-accd-93809530d1e0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.873843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459f67-ded4-427c-accd-93809530d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.874313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459f67-ded4-427c-accd-93809530d1e0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.876179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 193/409] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:44.877867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3459f67-ded4-427c-accd-93809530d1e0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.890963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.891594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.891876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.892189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.892890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:44.893197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.894598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861422b-2dfb-4309-aa25-eb6070c5d3ce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.905048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 217/410] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:44.906465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4975a21-6451-468b-aba6-d817770b905d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.906709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4975a21-6451-468b-aba6-d817770b905d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.906987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4975a21-6451-468b-aba6-d817770b905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.929775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d4975a21-6451-468b-aba6-d817770b905d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:44.930963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d4975a21-6451-468b-aba6-d817770b905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:45.008819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 218/411] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:45.016379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4975a21-6451-468b-aba6-d817770b905d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.019584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3459f67-ded4-427c-accd-93809530d1e0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.027705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.060279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.063143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.063143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.063143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.063143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.064913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.067760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 194/412] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:45.073728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.131073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.188996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db536c-5b4d-4084-bd39-4376c79689c9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.190911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4975a21-6451-468b-aba6-d817770b905d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.227849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.228810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.229233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.229645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.230975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.232699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.234983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 195/413] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:45.241989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.259174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.259731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.260032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.260530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] PATH_INFO: `/v3/groups/240fc97faa43487f9cea94ce4c424969` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.262082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] RBAC: Authorizing `identity:get_group(group_id=240fc97faa43487f9cea94ce4c424969)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.267122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.267122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 219/414] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/groups/240fc97faa43487f9cea94ce4c424969 => generated 230 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:45.271474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.378122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad73cf3-0b01-4640-816c-c49ca4e5c7af None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.398041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.417724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.418627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.420798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.420798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/groups/fec4a685fe5d403988dbc89327fb91f7/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.422101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe564f2f17cc479ebe0094d3be82ce50, group_id=fec4a685fe5d403988dbc89327fb91f7, role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.423815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.434711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.461468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d7ddf-d9a7-4cbb-8d7f-f4a54edff0f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.498989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.499850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.500301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.500964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] PATH_INFO: `/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.502240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] RBAC: Authorizing `identity:get_project(project_id=18e8867d5ccb4ae190c4e3acc02760b8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.503811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.507094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 220/415] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8 => generated 345 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:45.508173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.525508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 196/416] 10.222.0.122 () {58 vars in 1447 bytes} [Fri Aug 26 00:44:45 2022] PUT /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50/groups/fec4a685fe5d403988dbc89327fb91f7/roles/6597e480361e45bbb37dc41cff9e4582 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:45.532183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.666672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d748db6-09ec-48df-b007-7d44eb2b6d77 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.681971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247e781-4350-4596-a707-14ea1f6a5f7e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.713218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f441-e51c-4f82-aa65-2741cb0aa033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.714310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f441-e51c-4f82-aa65-2741cb0aa033 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.714801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f441-e51c-4f82-aa65-2741cb0aa033 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.715272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f441-e51c-4f82-aa65-2741cb0aa033 None admin] PATH_INFO: `/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8/groups/240fc97faa43487f9cea94ce4c424969/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.717414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f441-e51c-4f82-aa65-2741cb0aa033 None admin] RBAC: Authorizing `identity:create_grant(project_id=18e8867d5ccb4ae190c4e3acc02760b8, group_id=240fc97faa43487f9cea94ce4c424969, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.719060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f441-e51c-4f82-aa65-2741cb0aa033 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.747846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.749029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.749510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.749980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.765124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:45.771520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:45.772504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:45.773757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:45.776718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 221/417] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:45.794913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 197/418] 10.222.0.122 () {58 vars in 1447 bytes} [Fri Aug 26 00:44:45 2022] PUT /identity/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8/groups/240fc97faa43487f9cea94ce4c424969/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:45.796479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.812563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.934726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ae9c-746c-4786-9ba5-9026a344bfe0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.968707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da29bf-7069-448b-8284-cf9d3b6faa42 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.969223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da29bf-7069-448b-8284-cf9d3b6faa42 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.969223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da29bf-7069-448b-8284-cf9d3b6faa42 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.970830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 198/419] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:45.976962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.977240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.977509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.985641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.986347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.986628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.986953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.987647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:45.987947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.989976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:46.001878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:46.003078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:46.006988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 222/420] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:46.013356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:46.036024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:46.080395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 199/421] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:46.086411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:46.122186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfee47-cda1-404f-b6fd-a3529ab38943 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:46.159855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:46.160529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.160986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.161261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.233288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:46.234668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:46.305586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:46.359407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 223/422] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:46.365793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:46.501650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:46.513399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32968f-78b7-44d6-846b-6436916a0d3a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:46.573032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:46.574651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.575449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.576125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.577525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:46.579182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:46.583362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 200/423] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:46 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:46.595783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:46.636053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d741fe7-1600-493a-a30d-8dae11f21cc1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:46.659503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:46.683817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:46.684718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.685162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.687018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.710033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:46.717215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:46.718119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:46.719336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 224/424] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:46.726496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:46.764589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:46.815863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854600-9aaf-461c-932e-eadf7ca570e0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:46.885668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:46.886702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.887189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.887673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.890076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:46.891727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:46.896605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 201/425] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:46 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:46.900632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:46.918530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77e283-cf3a-4188-8428-cce9d9a9b6d1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:46.970750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:46.971443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.971691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.971875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.972570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:46.972864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:46.974911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e05b-898f-45b5-9a96-c0cdb1eadf0a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:46.987812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 225/426] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:46 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:46.987812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356168-4954-49e4-a04a-e52defc0c424 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.987812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356168-4954-49e4-a04a-e52defc0c424 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.987812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356168-4954-49e4-a04a-e52defc0c424 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.991544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 226/427] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:46 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:46.992768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.993047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.993388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.011433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:47.012692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:47.042898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3320a9-b901-4d1d-93b1-dd758eb676ab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:47.045151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:47.081358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:47.084840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:47.085815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:47.086428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.087385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=95e27803c0c0485da5f8d29ddcc12933) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:47.087976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:47.089775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:47.092263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 227/428] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:47.093176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.110566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 202/429] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:46 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 613 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:47.122944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:47.247016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e635e-4544-4a3e-96ee-d83153bcf9dd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:47.300064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:47.300658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:47.300936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:47.301728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.380713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:47.382241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:47.401517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:47.490180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 228/430] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:47.496414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.500039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.612319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109a48-dc61-4914-ad18-5c7b82631b53 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:47.633272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:47.638302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa131-97a1-403f-9f02-2bf8d1731eb1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:47.652637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:47.652637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:47.652904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:47.653189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.666104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:47.671339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:47.672473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:47.673796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 229/431] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:47.679143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.688934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:47.689849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:47.690274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:47.690688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] PATH_INFO: `/v3/projects/95e27803c0c0485da5f8d29ddcc12933` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.692655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] RBAC: Authorizing `identity:get_project(project_id=95e27803c0c0485da5f8d29ddcc12933)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:47.694299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:47.700961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 203/432] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/projects/95e27803c0c0485da5f8d29ddcc12933 => generated 299 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:47.702872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.744035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:47.802803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2b057-f87a-4e2e-ab53-e3ff0dd95540 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:47.827747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34912bfb-ea78-440c-b60b-dba5e2371160 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:47.840248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:47.840870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:47.841152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:47.841426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.842248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:47.842376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:47.843856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:47.854532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 230/433] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:47.859926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.871022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:47.871977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:47.872426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:47.872842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:47.874172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:47.876081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:47.883007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 204/434] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:47.884624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:47.913008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:47.970472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76ff0-245c-4ba3-8174-a169377414c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.000378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c033-e383-48e1-bb0f-c330131d7e1d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.002816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.015951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f180c1-2599-494e-ba6f-21a73599add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.016601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f180c1-2599-494e-ba6f-21a73599add6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.016880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f180c1-2599-494e-ba6f-21a73599add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.017150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f180c1-2599-494e-ba6f-21a73599add6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.048054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.048866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.049150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.049424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.050166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=95e27803c0c0485da5f8d29ddcc12933) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:48.050477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:48.052549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd32b-73dc-47d5-9539-c37ff287d4b4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:48.059490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 205/435] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=95e27803c0c0485da5f8d29ddcc12933&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 613 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:48.060861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352806cc-1688-41fa-9b14-6217de14880b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.061184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352806cc-1688-41fa-9b14-6217de14880b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.062269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352806cc-1688-41fa-9b14-6217de14880b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.067402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 206/436] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:48.069126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.069411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.069689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.090499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:48.091761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:48.109529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f180c1-2599-494e-ba6f-21a73599add6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:48.111172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f180c1-2599-494e-ba6f-21a73599add6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:48.161906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.172456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 207/437] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:48.236807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 231/438] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:48.242946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.357307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.364072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a9dd-bbae-42f6-bd22-7276f546b929 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.364414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ee24e-017d-4c70-8b43-c4701596c9d6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.364520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a9dd-bbae-42f6-bd22-7276f546b929 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.364698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a9dd-bbae-42f6-bd22-7276f546b929 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.365998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 232/439] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:48.371278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.371558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.371827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.391952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:48.418462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:48.418603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.418603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.418603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.418603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.418932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:48.418932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:48.418932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 208/440] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:48.418932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.495663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 233/441] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:48.496892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.551737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34760693-bf39-4782-bacb-15cc7e9d1ba9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.588180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.597357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.598414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.598414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.602254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.602254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:48.602254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:48.603937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 209/442] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:48.610076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.628020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed4ace-5bbc-4de7-8ced-6e2a76196b0e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.646336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.666809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.667709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.667988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.668285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.679440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:48.684012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:48.684929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:48.685706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:48.690152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 234/443] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:48.691002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.727698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09defc-1082-4733-b932-e7b5a74e1ebb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.763864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.764519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.764796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.765061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.765864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=14eb7ac5d26b4fcea5d73f096f87415b, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:48.766166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:48.767590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:48.784182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 210/444] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=14eb7ac5d26b4fcea5d73f096f87415b => generated 613 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:48.784182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.815161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219d5d-10b6-4ecb-bf0b-75865cf26300 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.846488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.853501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.859321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.859321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.859321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.859321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:48.859321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:48.859321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:48.867537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 235/445] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:48.873695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.888896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:48.895834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd15d4e-c748-4b4a-b1e2-3c65bb6db1d5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:48.937545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:48.938106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:48.938413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:48.938679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:48.951411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:48.956275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:48.957148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:48.958497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 211/446] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:48.963956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:48.995968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6f1ac-49b1-47f3-ab40-ca5f55e4ddc4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.034718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.035336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.036138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.036661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.091631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a00bd-c63c-41a1-a9e1-2024fda286bf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.110072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.122688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.123475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.136632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.137261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.137859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.138143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.139104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:49.139405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.140838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.150404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 212/447] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:49.155678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.174729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.227955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 236/448] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:49.233546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.255958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c695cf-e888-4fcb-8692-eaacfeae87ad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.289627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.290241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.290518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.290790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.323498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.332454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e8b70-4a96-4d9b-86d4-92dc34e2d927 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.358449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.359899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.367606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.368297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.368577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.368851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] PATH_INFO: `/v3/projects/fe564f2f17cc479ebe0094d3be82ce50` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.369982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] RBAC: Authorizing `identity:get_project(project_id=fe564f2f17cc479ebe0094d3be82ce50)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.371412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.373066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 237/449] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/projects/fe564f2f17cc479ebe0094d3be82ce50 => generated 303 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:49.378668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.380033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.467921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 213/450] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:44:49.474512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.489281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc605cd-6f7c-4185-a571-d8598d226d96 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.523897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.524552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.524831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.525104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] PATH_INFO: `/v3/groups/fec4a685fe5d403988dbc89327fb91f7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.526237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] RBAC: Authorizing `identity:get_group(group_id=fec4a685fe5d403988dbc89327fb91f7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.527698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.529281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 238/451] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/groups/fec4a685fe5d403988dbc89327fb91f7 => generated 227 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:49.535058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.563801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.571048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b33d8-1d20-4444-8ebb-d9e4d8d73f17 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.589575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.608642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.609683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.610125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.610693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] PATH_INFO: `/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.611881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] RBAC: Authorizing `identity:get_project(project_id=18e8867d5ccb4ae190c4e3acc02760b8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.613354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.619723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 214/452] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/projects/18e8867d5ccb4ae190c4e3acc02760b8 => generated 345 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:49.620783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.638544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765219-978b-4dbd-bda4-8b0967b9fa37 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.674522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.675120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.675399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.675669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.676526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] RBAC: Adding query filter params (group.id=fec4a685fe5d403988dbc89327fb91f7, role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=fe564f2f17cc479ebe0094d3be82ce50) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:49.676836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.678267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.684141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 239/453] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/role_assignments?group.id=fec4a685fe5d403988dbc89327fb91f7&scope.project.id=fe564f2f17cc479ebe0094d3be82ce50&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 613 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:49.726626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397665f-ada1-4d4e-ae0b-1425af255cfe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.763993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098bd60-925f-447f-83b1-7b9e36303ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.764588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098bd60-925f-447f-83b1-7b9e36303ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.764865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098bd60-925f-447f-83b1-7b9e36303ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.765134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098bd60-925f-447f-83b1-7b9e36303ca2 None admin] PATH_INFO: `/v3/groups/240fc97faa43487f9cea94ce4c424969` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.766295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098bd60-925f-447f-83b1-7b9e36303ca2 None admin] RBAC: Authorizing `identity:get_group(group_id=240fc97faa43487f9cea94ce4c424969)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.767730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098bd60-925f-447f-83b1-7b9e36303ca2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.769353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 215/454] 10.222.0.122 () {56 vars in 1185 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/groups/240fc97faa43487f9cea94ce4c424969 => generated 230 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:49.776260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.874638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.884422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856d6a6-7b42-4370-bf5e-4c8e05b41164 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.920016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.920723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.921004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.921270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.921991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] RBAC: Adding query filter params (group.id=240fc97faa43487f9cea94ce4c424969, role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=18e8867d5ccb4ae190c4e3acc02760b8) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:49.922297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.923730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8a35-c873-4cf9-8524-0eb6648f75b5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.930240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 240/455] 10.222.0.122 () {56 vars in 1381 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/role_assignments?group.id=240fc97faa43487f9cea94ce4c424969&scope.project.id=18e8867d5ccb4ae190c4e3acc02760b8&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 613 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:52.484028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9caea0-23ae-425b-a625-19f307053313 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.485077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9caea0-23ae-425b-a625-19f307053313 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.485554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9caea0-23ae-425b-a625-19f307053313 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.487061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 216/456] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:52.507609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8948-e87c-4e9b-8199-8eec8033b535 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.508215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8948-e87c-4e9b-8199-8eec8033b535 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.508484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e8948-e87c-4e9b-8199-8eec8033b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.537403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-632e8948-e87c-4e9b-8199-8eec8033b535 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:52.538227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bf3ce-08c2-40d1-bf2d-c7401e81e949 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.538519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bf3ce-08c2-40d1-bf2d-c7401e81e949 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.538724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-632e8948-e87c-4e9b-8199-8eec8033b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:52.538826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bf3ce-08c2-40d1-bf2d-c7401e81e949 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.540352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 217/457] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:52.547288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d817e-78a1-49fd-8856-29f999a04d59 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.547944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d817e-78a1-49fd-8856-29f999a04d59 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.548492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d817e-78a1-49fd-8856-29f999a04d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.571526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-477d817e-78a1-49fd-8856-29f999a04d59 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:52.573481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-477d817e-78a1-49fd-8856-29f999a04d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:52.638844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:52.653357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 218/458] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:52.697842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 241/459] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:52.942929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a058f1-3149-4d82-8e5b-12835010a074 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.943577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a058f1-3149-4d82-8e5b-12835010a074 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.944060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a058f1-3149-4d82-8e5b-12835010a074 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.945927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 219/460] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:52.951343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.951630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.951908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.962703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a058f1-3149-4d82-8e5b-12835010a074 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:52.980284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:52.981502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:53.068287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 242/461] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:53.069346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.093457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a058f1-3149-4d82-8e5b-12835010a074 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.132514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:53.164597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.165555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.165836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.166104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.185600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.187057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8c225157-c9c2-4edb-a487-dfc6deb88bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:53.214688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:53.215807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:53.216882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:53.216882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:53.216882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:53.219024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 220/462] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:53.220838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a8f9-4f2e-4072-a8b7-3e9986e6f808 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.221255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a8f9-4f2e-4072-a8b7-3e9986e6f808 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.221647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a8f9-4f2e-4072-a8b7-3e9986e6f808 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.228186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 221/463] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:53 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:53.229639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a8f9-4f2e-4072-a8b7-3e9986e6f808 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.252644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c08e54-7e18-4ba8-82c0-35d4be8b2cd6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.280559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:53.291673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.292548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.292863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.293255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.305748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.307435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e1016cdc-a027-4f60-95b3-4d70bf27cc72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:53.325969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:53.327128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:53.328173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:53.328173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:53.328173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:53.328762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 243/464] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:53.330050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.330429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.330795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.350194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:53.351576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:53.366670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a8f9-4f2e-4072-a8b7-3e9986e6f808 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.404984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.405592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.405877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.406132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.406765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:53.407063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.408471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.425581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 222/465] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:53.425581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.427084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:53.440212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 244/466] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:53.449177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.548869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:53.556405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c61013-7556-4718-8671-76fa4ed88387 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.596392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa06ced-3042-47e8-8f85-5bcbb749622c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.601880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.602671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.603100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.603519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.604351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:53.604798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.606752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.627448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 223/467] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:53.627448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.646250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.647085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.647381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.647656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.661206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.663420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:53.684852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:53.685808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:53.687061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:53.687061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:53.687061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:53.687061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 245/468] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:53.687061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.755904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:53.756389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e049a-1788-4145-b6e8-ea09257cfc78 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.795801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.796434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.796716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.796984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.797622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.800056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.816683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b5ba-ee91-48ea-91f8-e333662a4a1f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:53.853135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:53.853875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:53.854090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:53.854356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:53.855022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:53.856487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:53.889651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 224/469] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:53 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:53.890479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:53.913786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:53.940191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 246/470] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:53 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:53.940191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.063974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f989474-cf12-40d0-a401-fb81f111e314 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.101954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4470-1524-43de-8290-524be4fbd7c6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.112233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:54.118554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.118916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.119462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.119462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.120137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:54.120669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.122239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ae886-0474-4127-9336-0ba720bd793a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.136197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 225/471] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:54.137494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b2fb8-2ca9-4cbd-9dff-b15d3df11fbd None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.137851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b2fb8-2ca9-4cbd-9dff-b15d3df11fbd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.138120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b2fb8-2ca9-4cbd-9dff-b15d3df11fbd None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.139374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 226/472] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:54.144515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b2fb8-2ca9-4cbd-9dff-b15d3df11fbd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.154881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.155668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.155945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.156243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.168592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.170081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-67e4647b-d384-47f7-81a8-523c337a3ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:54.186435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:54.187576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:54.188608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:54.188608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:54.188608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:54.188608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 247/473] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:54.190273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.190273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.190436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.221914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:54.223665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:54.268747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:54.306758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b2fb8-2ca9-4cbd-9dff-b15d3df11fbd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.325036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 248/474] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:54.325949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.357504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.358393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.358813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.359221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.360099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.361931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.472746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:54.487974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331877ea-f095-4729-aa41-0795b5944a82 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.528110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.529076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.529526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.529984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.530776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:54.531221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.532919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.554499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 249/475] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:54.564270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.579658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 227/476] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:54 2022] POST /identity/v3/users => generated 249 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:54.652543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.785585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a3b0-0212-41a7-936c-3ed13ceb06ad None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.799786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44b25-115e-46cb-b369-8721e7d5ad5a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.832194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:54.841175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.842081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.842469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.842761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.843052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.843260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.843370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.843791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.843979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.844776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.849598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.849758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.895663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 00:44:54.895663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 00:44:54.895663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [parameters: {'id': '17bbc411198445b3821c264ee9b88a9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 00:44:54.895663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 26 00:44:54.913513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:44:54.914561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:44:54.915561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:44:54.924590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:44:54.926049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:44:54.929846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'id': '17bbc411198445b3821c264ee9b88a9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:54.931779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 00:44:54.936059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:54.939107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 228/477] 10.222.0.122 () {60 vars in 1136 bytes} [Fri Aug 26 00:44:54 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:54.939107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.955500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 250/478] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:54 2022] POST /identity/v3/users => generated 250 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:55.045511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc15c4-2437-42e7-81c9-9e072cc3b67c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:55.088660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098759a-64df-4336-8edc-1bfd6866971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:55.089228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098759a-64df-4336-8edc-1bfd6866971e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:55.089514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098759a-64df-4336-8edc-1bfd6866971e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:55.089785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098759a-64df-4336-8edc-1bfd6866971e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:55.102391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098759a-64df-4336-8edc-1bfd6866971e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b098759a-64df-4336-8edc-1bfd6866971e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:55.109948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:55.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:55.111773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 229/479] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:44:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:55.116958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:55.150353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:55.236213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8b2fd-7a7b-4d88-b83d-1cf945188c4d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:55.273613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:55.274240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:55.274619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:55.274896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:55.275569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:55.275871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:55.277304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538113-183f-4251-a24d-eec6cb98b632 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:55.287061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 251/480] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:44:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:56.230983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d421f-4084-4ce7-9df4-3406f0527c0f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:56.231543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d421f-4084-4ce7-9df4-3406f0527c0f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:56.231543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d421f-4084-4ce7-9df4-3406f0527c0f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:56.233097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 230/481] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:56.238640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bd425-8c59-41b1-a5f8-991eeb4150e2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:56.239777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bd425-8c59-41b1-a5f8-991eeb4150e2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:56.240457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bd425-8c59-41b1-a5f8-991eeb4150e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:56.269684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1b7bd425-8c59-41b1-a5f8-991eeb4150e2 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:56.271597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1b7bd425-8c59-41b1-a5f8-991eeb4150e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:56.365824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:56.377681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 252/482] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:44:56.514255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004027-89d6-47e9-a6cd-db2099c7dcc2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:56.514567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004027-89d6-47e9-a6cd-db2099c7dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:56.514741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004027-89d6-47e9-a6cd-db2099c7dcc2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:56.516331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 231/483] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:56.529915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d444-69cc-41a5-8dae-bffcbdfe5082 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:56.530207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d444-69cc-41a5-8dae-bffcbdfe5082 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:56.530462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d444-69cc-41a5-8dae-bffcbdfe5082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:56.557177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0113d444-69cc-41a5-8dae-bffcbdfe5082 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:56.558384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0113d444-69cc-41a5-8dae-bffcbdfe5082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:56.674259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 253/484] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:56.844369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004027-89d6-47e9-a6cd-db2099c7dcc2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:56.918692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:56.967102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5a51e-f568-4b60-842e-2395cac74563 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:56.967423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5a51e-f568-4b60-842e-2395cac74563 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:56.967659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5a51e-f568-4b60-842e-2395cac74563 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:56.969301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 254/485] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:56.976902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:56.977197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:56.977448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:56.996781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004027-89d6-47e9-a6cd-db2099c7dcc2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.011872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:57.014798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:57.058953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.059615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.059900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.060187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.083058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:57.089087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:57.090055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:57.090862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 232/486] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:57.096450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.168598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 255/487] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:57.169611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.292116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af757-9338-47ae-b25e-295dde2dd29f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.316536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:57.324505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:57.369811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.370343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.370619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.370887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.371582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:57.371879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.373301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.392949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 233/488] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:44:57.394922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f44d2-3071-4e8a-89a1-21b5ea1fcd0e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.399638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.447531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.448213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.448490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.448755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.463896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:57.469597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:57.470502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:57.471352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 256/489] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:57.472042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.541461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49b3c0-b922-420e-8dc3-4a68e484ac24 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.579791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.580467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.580750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.581018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.592973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.594559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.601484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad334fe-3990-4f6b-a06b-088d7c6982c1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:57.615063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:57.618625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:57.619484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:57.619484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:57.619484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:57.619484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 234/490] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:44:57.619484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.626557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:57.648143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492e205-82ad-4f14-8084-3e9f7a6c9fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.648809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e205-82ad-4f14-8084-3e9f7a6c9fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.649074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:57.649189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e205-82ad-4f14-8084-3e9f7a6c9fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.649379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e205-82ad-4f14-8084-3e9f7a6c9fd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.662919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492e205-82ad-4f14-8084-3e9f7a6c9fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4492e205-82ad-4f14-8084-3e9f7a6c9fd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:57.669603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:57.670474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 257/491] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:57.671242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21594d-7edc-4862-af4d-0eb1c71bc8b9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.671987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21594d-7edc-4862-af4d-0eb1c71bc8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.671987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21594d-7edc-4862-af4d-0eb1c71bc8b9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.677363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 258/492] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:57 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:57.678072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21594d-7edc-4862-af4d-0eb1c71bc8b9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.748112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7849f-a41e-40c3-ba2f-a8de70f89699 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.783228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.783834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.784114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.784416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.785077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:57.785377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.786825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.795343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 235/493] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:57.796268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.805426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21594d-7edc-4862-af4d-0eb1c71bc8b9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.839573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.840213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.840495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.840766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.841433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:57.841733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.843147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0870-d020-434e-8ea5-87ecc6381463 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.854801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 259/494] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:57.856092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54d57-9703-4432-9ad1-f7f3d6c6d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.856400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54d57-9703-4432-9ad1-f7f3d6c6d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.856731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54d57-9703-4432-9ad1-f7f3d6c6d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.875489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d2b54d57-9703-4432-9ad1-f7f3d6c6d9c2 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:57.877041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d2b54d57-9703-4432-9ad1-f7f3d6c6d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:57.890713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:57.902204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ce6b-183f-4ab0-a623-9831036b436f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.906984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:57.936252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.936850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.937136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.937407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.938055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:57.938356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.939727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.946074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 260/495] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:57.948194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8680f3-d652-48b4-8361-7567e361fe39 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.948688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8680f3-d652-48b4-8361-7567e361fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.949298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8680f3-d652-48b4-8361-7567e361fe39 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.950533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 261/496] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:44:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:44:57.951290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8680f3-d652-48b4-8361-7567e361fe39 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.954556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 236/497] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:57.955657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.063999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d4c35-93bd-4943-9d91-ebc1e6c75d91 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.067285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8680f3-d652-48b4-8361-7567e361fe39 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.113141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.114888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.115379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.115821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.117404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.118363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.118840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.119284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.128883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.131359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.136650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.139126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a8d5dbb9-de9c-4582-973b-cfacfcbb30d5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:44:58.154772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:58.155686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:44:58.156607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:58.163306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 237/498] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:58.163306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.163306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.163306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:58.165094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:58.166283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:58.167121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:58.167121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:58.167121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:58.169730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 262/499] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:58.169730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.185031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:58.186240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:58.189109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.193951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.257239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 238/500] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:44:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:44:58.258090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.280831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dcf4c-0eab-4ea5-93e7-62561b5f845f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.318027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.318755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.318835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.319154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.329625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.331085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:58.345767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:58.346678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:58.347513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:58.347513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:58.347513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:58.347513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 263/501] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:58.347746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.372911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c533d-c5cc-42ac-847a-e296e2ea7e8c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.411833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.412637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.413339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.413654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.414629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:58.414983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.417612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.423631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.451533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.458360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a855a-70dd-4070-a22a-1cb628cc3052 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.470099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 239/502] 10.222.0.122 () {56 vars in 1142 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:58.470099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.498170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.498890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.499369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.499477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.500063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:58.500387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.502047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.514861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 264/503] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:58.515707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.578396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775708c5-21ec-44f5-8872-f7540b39d0f0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.613618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.617432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.617432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.617432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.618027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9357334-d03c-427a-b47f-d35b0fcc3ced None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.626393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:44:58.632115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:44:58.633994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 240/504] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:58.634663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.650170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.655972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.657533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.657533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.657533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.657849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:58.658150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.659582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.671265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 265/505] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:58.672023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.699205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.747563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb11f-837b-4204-a6d5-9474d70d1dbb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.776921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906c6f-57be-4c59-928a-95c2d12a98a9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.782883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.783506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.783783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.784056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.812715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.813345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.813621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.813887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.822285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.823742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:44:58.836824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:58.837801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:44:58.838710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:58.840307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 266/506] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:58.841376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.853994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.855797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.892188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.914043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.944328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092598-bb3c-4dd3-bc85-436a04d3bae5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.961903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 241/507] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:58.961903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.979038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.979665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.979940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.980239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.991653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.993167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:59.007694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:59.008820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:59.009690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:59.009690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:59.009690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:59.009690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 267/508] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:59.009690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.069758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bcb18-7f77-4b8d-b16e-27dc172000e0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.116536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.117295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.117575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.117850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.118517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:59.118814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63be266-44ac-4fc1-b523-e7cf3015c2a7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.118955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.120228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.120666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.130200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 242/509] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:59.131045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.156067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.157515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.158068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.158345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.158617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.167654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.169687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:44:59.181966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:59.183121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 268/510] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:59.184296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.243191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325630-f2cd-4291-8371-3c5f83f9eba3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.277027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.277631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.277909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.278174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.278888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:59.279188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.280658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.289975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43c03-94f8-4a72-9b3e-d00b52945aff None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.298686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 243/511] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:59.299339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.324408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.325037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.325313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.325578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.336545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.337984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:59.352907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:59.353983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:59.355220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:59.355220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:59.355220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:59.355220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 269/512] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:59.355220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.371678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.382791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.404702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0b926-c283-4110-bc62-1e2347c362b5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.441484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.442253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.442857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.443378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.444022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:59.444426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.445811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.458223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 244/513] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:59.459294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.470098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe91205-1917-4599-a0f3-dcdde1cf9b95 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.508186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.508763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.509043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.509467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.522122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.523598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:44:59.538844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:44:59.540608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:44:59.541911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:44:59.541911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:44:59.541911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:44:59.542318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 270/514] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:44:59.543173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.566487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a886e-12cf-4f90-9af8-ec61f3471751 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.604989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.605759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.606052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.606335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.607053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:59.610789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.610789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.616139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.619364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.627862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 245/515] 10.222.0.122 () {56 vars in 1142 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:59.630627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.677344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef311-087a-4cc1-b77e-10d6f9a7e0d7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.725347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.726171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.726520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.726807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.736329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959b234-067f-4c92-a6f1-7266ba3f748f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.772662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.773617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.773988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.774360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.775094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:59.775482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.777139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.790424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 246/516] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:59.791255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.804812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.806539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.850983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.883460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.897128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd1603-9bad-4927-ac41-2e1a7cd5d0ae None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.921624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 271/517] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:44:59.922506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.941301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.943672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.944214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.944716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.945917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.948511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.025109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab801-8666-4ddd-bbad-09cc7268a881 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.038929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 247/518] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:44:59 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:00.039903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.075253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.076214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.076491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.076757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.077405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:00.077704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.079144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.097077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 272/519] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:00.098050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.136363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.172670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a29b8-464c-400e-b1de-eac4bed8fd00 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.189879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.218485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.219101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.219376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.219648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.226829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6467765-5f3d-4ba1-a9e6-dda0a068c6ac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.267416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.268056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.268355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.268628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.276344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.277745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:00.291230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:00.292184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:00.293044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 273/520] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:00.293526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.317482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.319011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.403963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.422453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812ce0-720d-4d82-ad2d-74ea22ac6c73 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.463373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 248/521] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:00.463373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.465015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.465801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.466086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.466364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.477929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.479873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.481489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:00.497662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:00.498680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:00.499615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:00.499615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:00.499615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:00.499615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 274/522] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:00.499615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.584656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4728-17ac-4628-ad15-79bdba050013 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.619687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c929f-d6bb-40cd-b799-42dc6526bd1c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.627118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.628111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.628644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.629131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.638283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.640017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:00.654787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:00.655967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 249/523] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:00.656915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.665017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.666052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.666552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.667102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.668045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:00.668536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.670148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.683112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.699901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 275/524] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:00.704274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.756779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.794485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d4206-60e3-46df-9ace-cc8ef30c7268 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.843438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118433d-d6a6-4866-a055-2f3b207914ca None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.847575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.848848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.849234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.849510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.860817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.862287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.872699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.873752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.874235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.874705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.875554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:00.876351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:00.877543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:00.878498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:00.879371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:00.879371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:00.879371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:00.879371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 250/525] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:00.879611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.880679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.899796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 276/526] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:00.900813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.959729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.990945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a6dc0-a94f-4748-b81b-e3ef58095f56 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.016880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd088a-4717-40a9-9bf8-834c46f10d76 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.017462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.034496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.035138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.035407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.035743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.036581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:01.036949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.038415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.058770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 251/527] 10.222.0.122 () {56 vars in 1144 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:01.059499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.064675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.065311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.065590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.065859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.066589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=db0844a1faa142d2a469fe561e4b72ac) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:01.067507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.069262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.075914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 277/528] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/role_assignments?user.id=db0844a1faa142d2a469fe561e4b72ac&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:01.076976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.210540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2245b-0904-4acc-baaa-12d2d1144d02 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.230289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16ecb6-712e-42f5-a363-f0edf8cb6a42 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.254108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.255244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.255530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.255794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.256463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:01.256767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.258152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.258651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.270770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 252/529] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:01.278156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.278331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.278427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.278427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.278427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.281137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.283266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:01.298304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:01.299225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:01.300323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:01.300740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 278/530] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:01.302030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.325496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.394953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7684e8e-cfdb-4587-b69a-4b42e4478fe1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.428579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404b6d5-fb3e-4d03-9cad-1db50680191f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.436361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.437046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.437407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.437742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.465887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.466440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.466719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.466996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.474695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.476302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:01.490230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:01.492318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 279/531] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:01.494289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.509465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.510928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.541297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.569069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.620300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ef62-8e88-4373-b54a-4949d51b6efc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.621347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 253/532] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:01.622262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.673409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.674285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.674571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.674840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.676047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:01.676910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.678828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.695946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 280/533] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:01.696928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.750683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ab555-3021-4a76-8c38-e3f761fc9c53 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.799447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.800059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.800855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.801132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.802666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:01.802973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.804689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.823804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a3875-c1ca-41cd-8fe2-5be52f398fe4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.824698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 254/534] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:01.825610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.829719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.831773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.875005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.877416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.877689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.877970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.893049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.895453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:01.918798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:01.919762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:01.920625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:01.920625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:01.920625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:01.922616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 281/535] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:01.922616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.957030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea7479-c2c2-407b-bf76-61774426713c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.007735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.008619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.009541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.009959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.010828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7fd5dcca78134cbcaba474e435c7fd7e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:02.011290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.013543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.022209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 255/536] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/role_assignments?user.id=7fd5dcca78134cbcaba474e435c7fd7e&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:02.023389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.054145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a6ef-48e9-4147-93ae-fcd136873a21 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.135577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.136320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.136604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.136874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.137614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=e77f464caecc4799b2c310ea640a3ea6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:02.137968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.140112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a04e-1c68-4504-9593-e8a2e9d53854 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.146995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 282/537] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/role_assignments?user.id=e77f464caecc4799b2c310ea640a3ea6&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:02.168727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:02.190777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454afe2-3746-4c4b-8303-9a28fe1374dc None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.190777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454afe2-3746-4c4b-8303-9a28fe1374dc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.190777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454afe2-3746-4c4b-8303-9a28fe1374dc None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.200212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 283/538] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:02 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:02.200212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.200212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.200212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.232313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:02.234395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:02.251936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e2eff-2693-4688-99ff-5298d8af9a14 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.258029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:02.319364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.320482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.320983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.321459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.322346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:02.322865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.324615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.348681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 256/539] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:02.349985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.385445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 284/540] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:45:02.517141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1fa8f-2b98-4658-9c8c-b79e9fe10b19 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.547615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:02.563256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.564348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.564808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.576452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.584501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.587019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:02.613553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:02.614982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:02.615963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:02.618346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 257/541] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:02.623983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.798005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ad966-d3eb-4553-8941-9da1219e9348 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.841030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.842134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.842641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.842923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.843614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:02.844138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.846236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.854017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.860435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 285/542] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:02.866941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.890680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:03.016754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413802a8-4c8e-4536-9f45-f4ee0c263b38 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.063742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.064379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.064697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.065227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.065978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=74c23495decd4d5e8a0a8ae47935ef9a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:03.066285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:03.068436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:03.075878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 286/543] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:02 2022] GET /identity/v3/role_assignments?user.id=74c23495decd4d5e8a0a8ae47935ef9a&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:03.113054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437dba5-7361-495f-acc7-dcae808eafd9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.177112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a7c5e-6fb4-4e35-8958-2f97353078e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.178155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7c5e-6fb4-4e35-8958-2f97353078e9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.178661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7c5e-6fb4-4e35-8958-2f97353078e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.179128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7c5e-6fb4-4e35-8958-2f97353078e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.201109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a7c5e-6fb4-4e35-8958-2f97353078e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-366a7c5e-6fb4-4e35-8958-2f97353078e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:03.206884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:03.207917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:03.208793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:03.215862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 258/544] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:03.217864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:03.356709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ad0d-81ae-40e2-b5e0-f66d094eed68 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.357365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ad0d-81ae-40e2-b5e0-f66d094eed68 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.357871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ad0d-81ae-40e2-b5e0-f66d094eed68 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.363842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 259/545] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:03.367177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.368074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.369299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.395977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:03.396871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:03.403338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:03.431424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c1d62-0c25-4862-9b55-7a66f67c1cba None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.450684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:03.479755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 260/546] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:03.501073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.501697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.501985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.502256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.502973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:03.503276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:03.505323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:03.516263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 287/547] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:03.525416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:03.705165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593954b-5d54-4a2f-9545-bc5baa610cb8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.758568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.759209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.759488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.759847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.770992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:03.772491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:03.789553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:03.794881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:03.796667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:03.797723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:03.797723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:03.797723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:03.797723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 261/548] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:03.802717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:03.874722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:03.910046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a383b8-ce7c-4d90-97a7-3106c6dc1971 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.961922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.962915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.963476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.963971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.981403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:03.989348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:03.995015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:04.000376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:04.001485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:04.004861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 288/549] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:04.007375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.034180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392d05-f56e-416e-8a2d-9c6172b00c60 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.076230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.077269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.077785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.078259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.079115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:04.079622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.081818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.099591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 262/550] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:04.105021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.221051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:04.235886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5867a-56e8-4bcf-92d4-61aa32320b04 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.277494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.278484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.278954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.279409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.287069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779904b4-0386-4ab1-bdc4-141b24575c58 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.288939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.290676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:04.323661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:04.324682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:04.325599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:04.329370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 263/551] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:04.335652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.373785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.374726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.375154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.377003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.377833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:04.378327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.380641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.402051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 289/552] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:04.405254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.527266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:04.579598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86280-f6bd-458d-b492-11e4a33e2ba1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.588296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1951-9396-40ae-95f0-5d7f60746d23 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.631337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.631875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.632538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.632765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.633034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.633308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.633543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.633918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.634872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:04.635235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.637080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fd5dc-1bc3-4b16-abcc-473c9407145f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.649719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.651412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.657351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 264/553] 10.222.0.122 () {56 vars in 1140 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:04.658708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38043-1333-4270-98a4-3d7f3338eca0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.658997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38043-1333-4270-98a4-3d7f3338eca0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.659270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38043-1333-4270-98a4-3d7f3338eca0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.661376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 265/554] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:04.668561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:04.670228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:04.671114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:04.671114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:04.671114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:04.671114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 290/555] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:04.673655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.673940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.674304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.677962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.689026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:04.697179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:04.699210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:04.788285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 266/556] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:04.788285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.800668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49f419-ba2b-4d18-a025-81ca2f4b7b15 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.813299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:04.846181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23032f-3869-4b62-8951-14bcdc7703c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.847178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23032f-3869-4b62-8951-14bcdc7703c1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.847658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23032f-3869-4b62-8951-14bcdc7703c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.848234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23032f-3869-4b62-8951-14bcdc7703c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.923759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23032f-3869-4b62-8951-14bcdc7703c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.925268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23032f-3869-4b62-8951-14bcdc7703c1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.929618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6fe4d-5f9e-453f-839b-09cbc170fbd3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.979461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.980500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.981507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.981985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.983128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:04.983879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.986220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87087949-ad2b-4981-b620-ef7deeb8760b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.990606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.002407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 267/557] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:05.004305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5955c65-4ac0-4be8-b87b-f7f89cc3f39f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.005135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5955c65-4ac0-4be8-b87b-f7f89cc3f39f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.005912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5955c65-4ac0-4be8-b87b-f7f89cc3f39f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.007810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 268/558] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:05.008838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5955c65-4ac0-4be8-b87b-f7f89cc3f39f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.034743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 291/559] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:05.036685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.036958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.037229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.056028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:05.057278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:05.059686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.130183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5955c65-4ac0-4be8-b87b-f7f89cc3f39f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.133407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 292/560] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:05.134289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.198691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.199973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.200730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.201203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.216803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.218852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:05.238084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:05.239597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:45:05.240712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:05.247904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 269/561] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:05.249132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.299791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ab245-d1a1-4595-b220-61c209db23fc None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.362471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.382554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.383426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.383567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.383750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.392236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.403949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.408410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:05.433890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:05.434891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:05.435797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:05.435797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:05.435797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:05.440165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 293/562] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:05.441107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.443900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900298b-d8a8-484c-8f07-3ef30e498716 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.490244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.491427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.491924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.492749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.508645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:05.514357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:05.515339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:05.516218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:05.520827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 270/563] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:05.521585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.556400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f83d1-cd7f-4c71-8a35-f516da03d348 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.594837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.595452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.595734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.596005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.596772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:05.597077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.634246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1083-424f-4f47-bf22-b4b21bef3992 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.650756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.667874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f27b9-54b1-4ee8-8e80-563a7e50d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.668536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f27b9-54b1-4ee8-8e80-563a7e50d17c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.668817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f27b9-54b1-4ee8-8e80-563a7e50d17c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.669091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f27b9-54b1-4ee8-8e80-563a7e50d17c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.679442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f27b9-54b1-4ee8-8e80-563a7e50d17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-732f27b9-54b1-4ee8-8e80-563a7e50d17c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:05.684489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:05.685535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:05.686362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:05.687158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 294/564] 10.222.0.122 () {56 vars in 1142 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:05.687539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.689178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 271/565] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:05.690364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ee14-9e67-4564-9c1f-ce15b807b7ec None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.690635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ee14-9e67-4564-9c1f-ce15b807b7ec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.690946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ee14-9e67-4564-9c1f-ce15b807b7ec None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.696833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 272/566] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:05.696833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ee14-9e67-4564-9c1f-ce15b807b7ec None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.743391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.795621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec1b3-5e59-49da-be92-73bfe7e9eb6f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.829818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.830528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.830697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.830967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.831604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:05.831905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.834251 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.845607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 295/567] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:05.846432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.851728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ee14-9e67-4564-9c1f-ce15b807b7ec None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.886551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.887073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.887352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.887627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.888412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:05.888725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.890098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.898702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 273/568] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:05.899492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.940206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.955038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85eb89-ecf5-47c4-bfec-1bf52f1c4ad9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.964455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.989807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.990443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.990722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.990992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.001044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f20f47-1cd1-417d-9abf-1a5553305280 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.002418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.003885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e54c9307-6f63-408f-8078-b0bf877a3a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:06.019416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:06.020516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:06.021403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:06.021403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:06.021403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:06.024302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 296/569] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:06.025937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.026224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.026500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.037413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.038030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.038309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.038579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.039241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:06.039541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.040945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.044064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:06.045287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:06.049137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 274/570] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:06.049942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.127795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 297/571] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:06.128698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.158903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.162976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27214e7-a15f-4c55-8675-48981b6aecf4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.205758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.206401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.206682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.206957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.215291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.216820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:06.230371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:06.231368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 275/572] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:06.232287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.244130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.255596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b90ba-3122-4873-88f5-aa248ae9bf7a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.294571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.295197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.295545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.295796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.307703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.310146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:06.327883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:06.328896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:06.329824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:06.329824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:06.329824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:06.333840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 298/573] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:06.334701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.342816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91b84-32ee-44f0-9b4f-fb51526278f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.379192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.379825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.380461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.380747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.381393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:06.381692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.383048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.394885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 276/574] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:06.395912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.419999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.449387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08898a-a5cd-4dbf-ac47-eb63b596267a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.483999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.484763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.485045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.485319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.497736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.499203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.501435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.502571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72cb49-eba0-41d7-adcb-5edeb801144e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:06.515477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:06.523056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:06.524213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:06.524213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:06.524213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:06.524213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 299/575] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:06.524213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.539334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.539939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.540248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.540520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.541208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:06.541510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.542932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.556208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 277/576] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:06.557271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.624844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ffa9b-93a0-43f3-a92f-2eab1a84151c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.641134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.662849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.663461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.663739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.664013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.664682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:06.664992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.666371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.667355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bfd34-7ceb-408c-b0df-d466787b1e5c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.679139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 300/577] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:06.679848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.715795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.716468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.716740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.717014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.723948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.725426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:06.737448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:06.738586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:06.740603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 278/578] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:06.741113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.745284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.796922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dbcf7-a88f-4009-ad26-2f3f3384b954 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.833423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.834111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.834324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.834594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.845938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e7ee-38f1-4833-bd96-10d7394685a7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.846326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:06.851307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:06.852445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:06.853528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 301/579] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:06.854348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.885242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.885852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.886132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.886410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.887043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:06.887339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.888740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.897778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.901594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 279/580] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:06.902413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.962944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f02dd-fb9c-4e70-ac60-bf355f2960cd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.978090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.998882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.999507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.999787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.000060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.001077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=42193a1473a0485787f60b5bd963e7ca) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:07.001386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.002884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.008419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3fea-be91-4c81-9887-981502a9ea95 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.009764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 302/581] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/role_assignments?user.id=42193a1473a0485787f60b5bd963e7ca&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:07.010833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.050131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.051020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.051435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.051882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.060475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.061956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:07.076197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:07.077226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 280/582] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:07.078233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.153174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.155061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4b18-323e-4515-a55e-d058115b3d07 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.197868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90d2f-e130-4132-8f80-5ec9e05c67d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.203577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.204217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.204499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.204776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.205456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:07.206287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.208102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.225656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 303/583] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:07.226351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.242772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.243496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.243828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.244244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.244966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:07.245266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.246806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.264665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 281/584] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:07.264665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.281889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.359298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d96d66-6eb0-4ff0-bbdf-caddfb025b86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.381248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b706130-8d66-4149-97d4-2dbbf658eb23 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.400831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.401475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.401755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.402018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.405900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.410357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.412803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.419900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.420998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.420998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.421170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.421822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:07.422121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.423533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:07.425878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:07.426879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:07.428051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 304/585] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:07.428790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.447341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 282/586] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:07.448215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.545394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.550675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04784b6-ecb2-41c5-a146-45b7ef39ced9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.570969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9ec2-4ad0-4661-b797-c93dbe38c5b8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.589264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.590503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.591019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.591320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/db0844a1faa142d2a469fe561e4b72ac/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.607699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.608356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.608676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.608896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.610419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=db0844a1faa142d2a469fe561e4b72ac, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.611934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.620281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.621729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:07.637873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:07.644043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:07.645129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:07.645129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:07.645129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:07.645129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 283/587] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:07.645129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.674168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.748199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 305/588] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:07 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/db0844a1faa142d2a469fe561e4b72ac/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:07.748199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.768085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7ed58-44d8-45bc-9d29-dc8614838fdc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.827100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.827875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.828369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.828736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.829652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:07.830167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.832067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.855581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 284/589] 10.222.0.122 () {56 vars in 1142 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:07.856493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.888537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872c97-be80-47e6-82c7-fea1620fdda6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:07.939808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:07.941020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:07.941020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:07.941020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:07.960325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:07.962393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:07.975257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.979310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:07.985841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:07.990252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:07.991141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:07.991141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:07.991141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:07.991141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 306/590] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:07.991141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:07.991416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5720f-0d8d-46b5-b979-69cc309228af None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.039368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.040171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.040461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.041555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.042271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:08.042583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.044047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.060649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 285/591] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:08.061608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.133236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37f549-3fbf-4ae9-8f4f-9875ebf10f2d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.178229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.179114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.179556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.179897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.193151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.194912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.195932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b22ec8-3124-44e0-8946-89db67945bf0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:08.212005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:08.214224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:08.215247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:08.215247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:08.215247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:08.219310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 307/592] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:08.220434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.234288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.234901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.235177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.235444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.236229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:08.236564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.237924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.252042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 286/593] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:08.258286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.270946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:08.283146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:08.341420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a32-10a7-428f-83b8-0bb6ee8d2b00 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.381303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.382346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.382848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.383404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.386243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8aa8e-d7fe-443e-87b1-ec95fbc4ff25 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.392725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.394436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:08.407724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:08.408757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:45:08.409707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:08.412210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 308/594] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:08.413182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.428055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.428761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.429037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.429482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.430261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:08.430569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.432868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.453562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 287/595] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:08.454711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.530486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:08.542797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61c34e-672e-4295-a020-44d37d350859 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.560049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:08.564086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568d6e-2e67-4479-89c3-8216ffc132e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.588352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.589258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.589547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.589819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.600341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.601779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.603558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.604420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.604853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.609000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.609000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:08.609000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.609000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:08.614845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:08.615946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:08.616961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:08.620819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 309/596] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:08.621882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.637956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 288/597] 10.222.0.122 () {56 vars in 1144 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:08.639083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.741553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d513ba-57e2-4e19-b623-30ef79982c7f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.754219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa919b-b4e6-4ff2-887f-c19c4732a5ea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.778544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.779328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.779722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.780090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.788732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:08.790982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.792589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.797827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.803713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.803713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.803713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:08.803713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:08.803713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:08.803713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:08.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:08.806761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:08.807857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:08.814156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 310/598] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:08.814156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.827713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 289/599] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:08.828871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:08.861826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:08.950958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487f99-b6c4-4531-8e55-77c8c0b55341 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.967841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a583390-474f-468f-9ed1-24bee11a435a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:08.993625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:08.994431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:08.994720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:08.994992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.006537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:09.007146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.007423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.007523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.007698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.008400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:09.008705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.009006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.010109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.027780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 290/600] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:09.027780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3062d6c5-7ace-446b-be48-7bacc6df0787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:09.028054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:09.028962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 311/601] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c96ca-3de2-4758-a6e0-479b019cab08 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c96ca-3de2-4758-a6e0-479b019cab08 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c96ca-3de2-4758-a6e0-479b019cab08 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.029833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 312/602] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:09 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:09.031428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c96ca-3de2-4758-a6e0-479b019cab08 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:09.096539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:09.122128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:09.142089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c96ca-3de2-4758-a6e0-479b019cab08 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:09.161312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720cde3-c528-4a79-ab44-2419ee00c170 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:09.178509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:09.179168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.179445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.179718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/e77f464caecc4799b2c310ea640a3ea6/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.195191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=e77f464caecc4799b2c310ea640a3ea6, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.196672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.199833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5af7-99d6-4daa-9237-3fb6dffac06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:09.200913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5af7-99d6-4daa-9237-3fb6dffac06f None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.201240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5af7-99d6-4daa-9237-3fb6dffac06f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.201460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5af7-99d6-4daa-9237-3fb6dffac06f None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7fd5dcca78134cbcaba474e435c7fd7e/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.216180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de5af7-99d6-4daa-9237-3fb6dffac06f None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=7fd5dcca78134cbcaba474e435c7fd7e, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.217630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de5af7-99d6-4daa-9237-3fb6dffac06f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.284381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 313/603] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:09 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/e77f464caecc4799b2c310ea640a3ea6/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:09.285218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:09.344134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 291/604] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:09 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7fd5dcca78134cbcaba474e435c7fd7e/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:09.346848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.347609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.348631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.395268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:09.398264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:09.463022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb9ea-63f3-40bc-a259-23b63c425b14 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:09.510183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:09.510558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.510728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.510997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 292/605] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:09.511134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.514081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:09.514081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.514081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.516798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:09.527980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 314/606] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:09.533457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:09.568783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:09.659870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c57ff-6b45-4d39-8982-4bd95de30906 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:09.706426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:09.707096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.707401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.707672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.715298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.716707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:09.729619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:09.730567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:09.731447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 293/607] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:09.736783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:09.826483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:09.872432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f12aa-436d-4e27-b860-abc339511176 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:09.908596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:09.909224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:09.909484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:09.909751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:09.910451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:09.910860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:09.912925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:09.931903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 315/608] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:09.934103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:10.001549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:10.010716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:10.028751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77542be-6bcc-4bf8-95bb-4b55246a190e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:10.060399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff62fbc-cbf1-4dc1-aa1c-b421a62ec8fc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:10.080485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28b464-e24b-4351-91be-53ee43893193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:10.081169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28b464-e24b-4351-91be-53ee43893193 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.081448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28b464-e24b-4351-91be-53ee43893193 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.081717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28b464-e24b-4351-91be-53ee43893193 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.095899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28b464-e24b-4351-91be-53ee43893193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:10.101825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95514404-65ac-4449-a24c-dd26c6fe138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3d28b464-e24b-4351-91be-53ee43893193 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:10.102206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:10.103320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:10.104179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:10.104824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95514404-65ac-4449-a24c-dd26c6fe138b None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.104824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95514404-65ac-4449-a24c-dd26c6fe138b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.104824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95514404-65ac-4449-a24c-dd26c6fe138b None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/74c23495decd4d5e8a0a8ae47935ef9a/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.107041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 294/609] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:10.108544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfaeaf-1d8c-4b34-9102-e5da1c06a5a7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.109050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfaeaf-1d8c-4b34-9102-e5da1c06a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.109701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfaeaf-1d8c-4b34-9102-e5da1c06a5a7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.116685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 295/610] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:10 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:10.117812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfaeaf-1d8c-4b34-9102-e5da1c06a5a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:10.120586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95514404-65ac-4449-a24c-dd26c6fe138b None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=74c23495decd4d5e8a0a8ae47935ef9a, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:10.122451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95514404-65ac-4449-a24c-dd26c6fe138b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:10.236505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 316/611] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:09 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/74c23495decd4d5e8a0a8ae47935ef9a/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:10.239014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.240861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.242814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.253686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfaeaf-1d8c-4b34-9102-e5da1c06a5a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:10.286372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:10.290418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:10.340598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:10.342862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.343431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.344254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.345747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:10.346739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:10.350960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:10.368572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 296/612] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:10 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:10.375484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:10.400904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:10.441196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 317/613] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:10.513483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219605ed-d542-438d-b41f-c6db56822668 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:10.562031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:10.562669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.562947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.563215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.578254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:10.579710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:10.601449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:10.602453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:10.603397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:10.603397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:10.603397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:10.603397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 297/614] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:10.610574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:10.679288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:10.765218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f06243-11ee-40c5-b3e5-9d95f079f9cc None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:10.796608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:10.834442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:10.835371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:10.835834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:10.836338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:10.837186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:10.837671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:10.839224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:10.866897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 318/615] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:10.876501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:10.892521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:10.971842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ec011-9dfc-4fac-bab9-138e340494cb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.045078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.045644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.045923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.046192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.054395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:11.062482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f934b8-72b3-4b33-8f8b-3c4c228c4bdc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.076803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:11.084432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:11.085460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:11.086332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 298/616] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:11.094833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.107585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961735-e790-47de-a214-6981205d159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.108255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961735-e790-47de-a214-6981205d159b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.108541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961735-e790-47de-a214-6981205d159b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.108811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961735-e790-47de-a214-6981205d159b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.119823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961735-e790-47de-a214-6981205d159b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.121324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961735-e790-47de-a214-6981205d159b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9c961735-e790-47de-a214-6981205d159b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:11.137242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:11.139520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:11.142009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 319/617] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:11.148178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961735-e790-47de-a214-6981205d159b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.282020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574c55-64a1-45aa-9e5d-aa5b5553a562 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.318126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:11.324879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.326423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.326710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.326984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.327672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:11.327975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.329389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.346411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 299/618] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:11.349308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.444960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961735-e790-47de-a214-6981205d159b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.461884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa8223-4d76-4d53-a696-f62524a2b2ba None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.499212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.499852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.500135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.500432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.514162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.515741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:11.531752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:11.532824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:11.533720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:11.533720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:11.533720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:11.537934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 300/619] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:11.539705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.584044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.584653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.584936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.585206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.585954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:11.586260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.586664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:11.588073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d02a-7a0d-417f-981f-3445b65cb1f0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.614453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 320/620] 10.222.0.122 () {56 vars in 1140 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:11.615930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5d7b-0cdd-44bf-bc5c-5241af7e3469 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.616351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5d7b-0cdd-44bf-bc5c-5241af7e3469 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.616631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5d7b-0cdd-44bf-bc5c-5241af7e3469 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.618380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 321/621] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:11.623872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.624312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.624684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.646488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:11.647855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:11.657295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:11.658388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6cb2a-d928-44bd-84f4-b56ddf8be34f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.703206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.704352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.704777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.705211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.706635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:11.707091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.709227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163e733-b73e-48a1-840a-1ecdf106c42a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.725899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 322/622] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:45:11.725899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.730722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 301/623] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:11.732686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163f58-792a-4acc-8c00-4dd9eff6b535 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.733123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163f58-792a-4acc-8c00-4dd9eff6b535 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.733537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163f58-792a-4acc-8c00-4dd9eff6b535 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.735243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 302/624] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:11.736107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e163f58-792a-4acc-8c00-4dd9eff6b535 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.837921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be44ab-6ed4-490f-ae9a-e6b48ff142de None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.856246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e163f58-792a-4acc-8c00-4dd9eff6b535 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.868725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:11.877422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.880550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.880550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.880550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.891366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.893274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.896241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:11.900664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.901405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.901680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.901946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.911937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.913437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d688966b-aea1-45f5-9e69-8c24baead564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:11.914885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:11.915819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:11.916827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:11.916827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:11.916827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:11.923346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 323/625] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:11.923346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.923346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.923346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:11.934452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:11.935473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:45:11.936493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:11.940239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 303/626] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:11.943088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.948919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:11.951694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:12.023769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 324/627] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:12.024710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.063105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fc240-42c9-472d-a896-af97a6afb3b1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.111164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.111639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.111920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.112208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.112900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:12.113330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.115152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.128896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 304/628] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:12.129874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.148961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.157917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1eb6e-f333-4c64-97fe-c8b6237ff171 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.191121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.206449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.207904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.208419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.208884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.209800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:12.210296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.212529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.242312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5d7d-e60e-4c61-965f-ce794b94966f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.242508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 325/629] 10.222.0.122 () {56 vars in 1142 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:12.243279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.290625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.292024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.292542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.292821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.307253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:12.312128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:12.313160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:12.313987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:12.316250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 305/630] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:12.317299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.365084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84563aa1-433e-4a5b-a829-77f333d7dd2b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.403064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.403704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.403985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.404288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.404442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.412417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.413885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:12.426897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:12.427825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:12.428799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:12.429771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850618-1392-48e4-9afe-1b52ad77165f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.433116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 326/631] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:12.433821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.464998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.465601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.465880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.466148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.479970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.539474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.540548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697522a-01e4-4ebc-b01a-b26e9e393838 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.540954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.578069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.578852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.579136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.579411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.592143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:12.596941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:12.597887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:12.598860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 327/632] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:12.599666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.625052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.650906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 306/633] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:12.652228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.728992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c509bea-bc00-4cf6-9b76-b2d30ed0a2ae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.730738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.758870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce461ad-ab67-47fd-a0f4-1b0bc7e9f176 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.764030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.764676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.765272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.765554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.766238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:12.766543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.767925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.776894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 328/634] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:12.777520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.795248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.795853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.796128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.796423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.797100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:12.797398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.798855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.811060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 307/635] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:12.811727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.846938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.879920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50495380-4e59-49cd-a5d8-2c6d74740ff9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.912378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33124bb-7443-4db5-b60d-40779ae8da37 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.914967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.915572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.915847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.916116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.916792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:12.917085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.918445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e28aa-37f8-40c6-820c-ad1cc7c26937 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.926440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 329/636] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:12.927622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee423443-a411-490c-8e83-efd46102021f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.927899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee423443-a411-490c-8e83-efd46102021f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.928264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee423443-a411-490c-8e83-efd46102021f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.932191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 330/637] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:12 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:12.932191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee423443-a411-490c-8e83-efd46102021f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.950584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.951243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.951521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.951793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.961503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.964535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.966246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:12.981828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:12.983017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:12.983916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:12.983916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:12.983916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:12.983916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 308/638] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:12.983916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.046104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee423443-a411-490c-8e83-efd46102021f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.075584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.080811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.081432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.081704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.081971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.088054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e1b0-bb95-435b-8fa2-983e48829b64 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.093972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.095463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:13.110454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:13.111642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:13.112588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:13.112588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:13.112588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:13.112588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 331/639] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:13.112588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.127737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420efb-34dd-4615-85c2-b8367fad736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.128403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420efb-34dd-4615-85c2-b8367fad736a None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.128683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420efb-34dd-4615-85c2-b8367fad736a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.128954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420efb-34dd-4615-85c2-b8367fad736a None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/42193a1473a0485787f60b5bd963e7ca/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.144674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420efb-34dd-4615-85c2-b8367fad736a None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=42193a1473a0485787f60b5bd963e7ca, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.146986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420efb-34dd-4615-85c2-b8367fad736a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.193459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.214362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea753b4-d4b1-4647-a25c-9c2021b9f946 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.215318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 309/640] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:12 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/42193a1473a0485787f60b5bd963e7ca/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:13.216642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.216922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.217196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.236336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:13.237657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:13.256257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.256915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.257197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.257474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.271661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.273248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:13.290185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:13.291483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:13.292860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:13.292860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:13.292860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:13.292860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 332/641] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:13.292860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.323415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 310/642] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:13.324201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.437299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db949-2b87-4789-b77d-404a9bc92fa2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.449986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.465283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a78b-9126-45d5-a125-160a66eb6574 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.469911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.476592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.477210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.477601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.477965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.478762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:13.479152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.480743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.493888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 333/643] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:13.495097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.513593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.514338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.514542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.514973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.515927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:13.516279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.517687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.533890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 311/644] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:13.534795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.630389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeadea8-0b1b-43aa-b6b0-bc809b8da9bd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.665108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083bf5-a7a3-470f-9cfa-3e141e3ddcc1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.675686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.677140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.677140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.677365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.678215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:13.678517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.679919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.694831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 334/645] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:13.695943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.698924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.708716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.709384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.709665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.709937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.717738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.719234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:13.731897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:13.732893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:13.733921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:13.737909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 312/646] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:13.739361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.765138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.825393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb44a-3c3d-40b4-9592-41af3ef8d0fd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.861591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5e60f-2871-4e3f-a64e-db754cb0834c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.864839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.865517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.865794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.866063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.874253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.875978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:13.888429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:13.889641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:45:13.890817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:13.894194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 335/647] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:13.895081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.902273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.902912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.903190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.903462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.915354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:13.920659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:13.921570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:13.922408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 313/648] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:13.923129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.980629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.012991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b0f9-1481-4ef0-b880-6a46d48f4fdd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.023581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.038121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb82d-0ac9-4fc4-8639-aac93c1b71d7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.047904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.048658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.048941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.049276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.058073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.059534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:14.071250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:14.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 336/649] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:14.073395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.081972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.084205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.084205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.084205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.084491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:14.084676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.086113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.101001 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 314/650] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:14.101665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.189846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acdbca-8ad4-4b95-849c-18fb3a10cc31 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.222705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414cddf-4f90-4c3d-858b-7437b1d62b87 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.225755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.226376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.226660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.226935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.227666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:14.227971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.229451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.236577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.253268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 337/651] 10.222.0.122 () {56 vars in 1142 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:14.253268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.267939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.268601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.268874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.269142 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.270440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:14.270818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.272405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.281301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.287855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 315/652] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:14.287855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.364515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6b84-940f-4288-8a36-24eaed09f466 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.397300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2d936-f923-4ae4-a16e-58b76a2f82b8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.401122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.401740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.402020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.402295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.403029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:14.403338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.405228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.425067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 338/653] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:14.429602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.432426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.433031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.433304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.433573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.434287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=db0844a1faa142d2a469fe561e4b72ac) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:14.434601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.436024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.441758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 316/654] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/role_assignments?user.id=db0844a1faa142d2a469fe561e4b72ac&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:14.442542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.502849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.543457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.559972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b7cbc-b24f-4297-b4cb-2c73aa677dfa None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.603359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a6c8e-3a89-437a-b07c-01b1c97a2c72 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.609049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.610951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.610951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.610951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.652387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.653026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.653312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.653569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.666747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.668232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:14.686688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:14.687712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:14.688725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:14.688725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:14.688725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:14.688725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 317/655] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:14.688725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.706010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.707541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.802180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.814926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68faa16-6a8a-4841-825d-45062e3849d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.816489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:14.837900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 339/656] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:14.838873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.860699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:14.861473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:14.861841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:14.862205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:14.937868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:14.939587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:14.960799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7d264-0f35-44e0-8437-4bbc8bd2411f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:14.999316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.000256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.000929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.001637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.002525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:15.002974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.004597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.017958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 340/657] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:15.019097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.034578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.058123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 318/658] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:15.059119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.073566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.144098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3c25f-6933-4a79-a15e-8b5cfbddcb1f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.175239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5917-53a6-4fcd-8be9-c7f9db378cb0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.196096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.197812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.198472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.199002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.212331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.212815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.212988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.213287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.213555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.214341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.221238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.222505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:15.229849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:15.231626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:15.232883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:15.232883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:15.232883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:15.232883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 341/659] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:15.232883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6d288775-6b77-4850-9bd5-bb133ad21053 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:15.243141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:15.244124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 319/660] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e5e20-6171-4f24-8c25-dec88c9b5631 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.245116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e5e20-6171-4f24-8c25-dec88c9b5631 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.249863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e5e20-6171-4f24-8c25-dec88c9b5631 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.249863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 320/661] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:15.249863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e5e20-6171-4f24-8c25-dec88c9b5631 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.305524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.340905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.344786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b510592-2d62-4f4d-a68d-4adccc3db433 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.364657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e5e20-6171-4f24-8c25-dec88c9b5631 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.381487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.382127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.382402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.382674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.394812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.397084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.404185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.404790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.405112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.405387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.406011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:15.406309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.407647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b0085-71ad-481e-b5e5-cb3825dc45a9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:15.412889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:15.413914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:15.414812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:15.414812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:15.414812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:15.416181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 342/662] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:15.417104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.428804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 321/663] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:15.430295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.430585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.430854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.449441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:15.450801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:15.524214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 322/664] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:15.525078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.534961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951e05-f050-4f3e-8c5a-ee4b99f683eb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.574541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.583248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.583925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.584713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.584713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.585203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:15.585829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.587534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.614075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 343/665] 10.222.0.122 () {56 vars in 1144 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:15.615389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.630993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.655781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0298f98-5f9c-41a9-b642-c78ef3d45772 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.702167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.702998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.703340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.703678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.704909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:15.704909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.706240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.720554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 323/666] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:15.721649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.745371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112f57-031d-4f29-8852-908dc12e0801 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.782966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.783617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.787819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.788132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.795819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.797323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:15.810302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:15.811397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 344/667] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:15.812684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.841663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.847653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e38f7-9404-4215-8aa9-ce9c28f62b2b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.895812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.896513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.896886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.897273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.899056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.936357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca3329-3f12-44a9-991f-a7e5ca2f82a7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.966365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.967906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.976249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.977205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.977662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.978134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.985709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.987447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:16.002117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:16.003243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:16.006849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:16.010126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 345/668] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:16.011034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.095281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.103726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 324/669] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:16.104683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.128633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde381-aaab-4296-85e0-3c34a51fa821 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.164296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.172864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.174192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.174192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.174192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.186190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:16.191173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:16.193622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:16.195321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:16.198532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 346/670] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:16.199300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.238672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420dc39-5f91-4ccb-86cc-6f0e1729fdbc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.277538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.278143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.278419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.278686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.279383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.279667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.281135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.294322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 325/671] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.295166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.323097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b6a3b-2a43-4747-a0d3-47b9a345d599 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.360504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.362371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.363169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.363437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.364657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.365370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.365951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.367982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.385385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 347/672] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.386537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.415402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39e0d-55fd-4292-a3a5-86a3d928de96 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.444926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.449216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.449849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.450127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.450393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.463189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.464690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:16.483156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:16.484256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:16.485196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:16.485196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:16.485196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:16.489333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 326/673] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:16.490723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.519210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d65b-961e-4e14-bdbf-4a1669e0642a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.562940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.563563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.563837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.564105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.564805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.565113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.566496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.575838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 348/674] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.576742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.626104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40b84-0181-4005-8df2-c2a499bba049 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.640762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.672941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.673566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.673847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.674130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.674847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=e77f464caecc4799b2c310ea640a3ea6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.675153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.677039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.683016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 327/675] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/role_assignments?user.id=e77f464caecc4799b2c310ea640a3ea6&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.684401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.697583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818defa-b384-4b53-a5a6-3f5b4b8e8b86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.710176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.737755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.738726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.739416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.739910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.740946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7fd5dcca78134cbcaba474e435c7fd7e) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.741416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.743279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.751019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 349/676] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/role_assignments?user.id=7fd5dcca78134cbcaba474e435c7fd7e&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.752211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.886775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f055a2-9a9d-4895-8439-fdbbf59ee5ed None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.908786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b51cd-b997-478b-a9ee-c9aff4e34cb3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.936658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.937827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.938124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.938404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.939361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.939671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.941924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317114d-4ae2-4ba6-810f-b454612b71c3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.953318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.953964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.954243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.954519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.961425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 328/677] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.962893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804d478-ca6d-46db-9301-28237ad0abed None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.963183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804d478-ca6d-46db-9301-28237ad0abed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.963473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804d478-ca6d-46db-9301-28237ad0abed None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.964940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 329/678] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:16.965596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804d478-ca6d-46db-9301-28237ad0abed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.974782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.976370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a8d9c1e1-019c-4245-a044-d754800ccf17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:16.996226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:16.997434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:16.998627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:16.998627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:16.998627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:16.998627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 350/679] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:16.999540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.999862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.001321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.017340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.022155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:17.022916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:17.053059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.111823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 351/680] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:17.112879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.123733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804d478-ca6d-46db-9301-28237ad0abed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.197067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.198014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.198636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.199070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.210657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.212192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:17.226804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:17.227801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:17.228760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 330/681] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:17.237113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.290270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49870a7c-50b9-4a22-8f79-b7bad62c06bb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.338258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.339042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.339204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.339382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.340022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:17.340346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.345592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.369573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 352/682] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:17.380028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.381425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.391338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d24-f71e-4c24-84e6-f46d30f4d9ab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.414948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.429597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.430470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.430746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.431019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.431914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:17.432596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.434285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.451067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 331/683] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:17.451827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.536837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5297bcb-76c8-4a5a-82ef-580f07c85a32 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.571728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfc035-dfd2-415e-b17a-c35de69fb02c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.585545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.586887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.587923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.588593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.600776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.603172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.609212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.609983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.612099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.612099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:17.618377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:17.619332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:17.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:17.624145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 353/684] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:17.625328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.629653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.631636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:17.648992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:17.650026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:17.656441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:17.656441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:17.656441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:17.656441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 332/685] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:17.656441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.662303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.725966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.750063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690865a-f86d-47f5-b013-2eecb77b8823 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.789498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.790511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.790961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.791437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.792362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=74c23495decd4d5e8a0a8ae47935ef9a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:17.792842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.794437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.794544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4021d9-5de8-41cb-9007-bbd03aa9fab2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.802201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 354/686] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/role_assignments?user.id=74c23495decd4d5e8a0a8ae47935ef9a&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:17.803247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.840650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.841639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.841988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.842331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.843137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:17.843507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.846146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.870545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 333/687] 10.222.0.122 () {56 vars in 1140 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:17.879958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.950313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e47168-8da8-4046-8e87-749ecf11f32e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:18.008089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:18.020971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:18.021587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.021872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.023019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.023019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:18.023208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:18.024491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:18.040569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:18.043696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 355/688] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:18.053177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:18.057716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0706-14e9-4b01-920a-222947c40f53 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:18.106996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:18.107615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.108182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.108508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.188229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ff20-8dc6-4604-bb86-e627def9c622 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:18.204985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:18.206748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:18.231799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:18.232444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.232728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.233008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.234305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:18.236021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:18.289088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:18.331229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 334/689] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:18.344382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 356/690] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:45:18 2022] POST /identity/v3/users => generated 255 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:18.344988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:18.463122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a661878-f25c-4279-9a03-0ac76c087226 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:18.509087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:18.509751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.510088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.510430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.523867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:18.525400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:18.546913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:18.549120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:18.551728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:18.551728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:18.551728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:18.551728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 335/691] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:18.558128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:18.639193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:18.720880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc184d-034d-4555-a80c-0969762f339b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:18.786562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:18.787565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.788046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.788539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.789697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:18.790197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:18.792722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece5d9-4e76-4c17-99b9-5266e5928d14 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:18.822316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 357/692] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:18.825273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:18.857870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:18.974586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e4db-f731-4e6a-b9eb-c8e3e862718f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.974964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e4db-f731-4e6a-b9eb-c8e3e862718f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.975167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2e4db-f731-4e6a-b9eb-c8e3e862718f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.976881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 358/693] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:18.982030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:18.982312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:18.982586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:18.987689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b821e-173a-49a5-843f-b6f4a0a9e091 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:19.001945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:19.003147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:19.049068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:19.049721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.050105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.050387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.065278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:19.067295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:19.081304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 359/694] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-95991d14-981f-44c9-84a8-b9d0f64589cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:19.090349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:19.091323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:19.092845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 336/695] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:19.098679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.167613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:19.239523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1d02-fb99-4f06-a261-a6542f339df9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.240182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1d02-fb99-4f06-a261-a6542f339df9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.240662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1d02-fb99-4f06-a261-a6542f339df9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.242723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 337/696] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:19.248454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.249095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.249563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.249826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351776ae-5136-415a-b7ee-09441a955e4c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:19.289332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:19.291051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:19.291291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:19.292086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.292405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.292678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.293379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:19.293681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:19.295474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:19.310235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 360/697] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:19.317533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.413562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 338/698] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:19.452008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30d79-68d2-440b-a13c-be496356078a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:19.461000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:19.489908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:19.490898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.492102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.492614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.493983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=42193a1473a0485787f60b5bd963e7ca) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:19.494528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:19.497263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:19.502014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.506881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:19.511121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 361/699] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/role_assignments?user.id=42193a1473a0485787f60b5bd963e7ca&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:19.701669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954626-251f-4029-8f14-d7c8a4e9f032 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:19.745971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:19.746609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.746929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.747206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.747787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:19.749174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:19.761500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:19.762567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:19.764040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 339/700] 10.222.0.122 () {56 vars in 1134 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:19.769277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.789298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.863311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:19.887008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722e922-51e2-4d48-a093-81b794979490 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:19.902997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49056-430b-4d8f-afaa-b8ad83f002eb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:19.928249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:19.928873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.929151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.929424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.930165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:19.930469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:19.932021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:19.938945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 362/701] 10.222.0.122 () {56 vars in 1129 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:19.945216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.947020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:19.947844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:19.948319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:19.948763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:19.961694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:19.968988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:19.970205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:19.971244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:19.979205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 340/702] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:19.981397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:19.992474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:20.089244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c43df-dd04-40af-b3e5-e498f9a862a6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.110920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d814c5-4973-44a7-a633-64cfd32e2b82 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.135180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.136143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.136645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.137097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.137942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:20.138480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.140072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.148756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:20.148952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 363/703] 10.222.0.122 () {56 vars in 1129 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:20.165024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.165843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.166177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.166454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.167200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:20.167513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.169053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d20a-80b5-4905-9328-94d0e9021be7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.183938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 341/704] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:20.185970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:20.334583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199799-622d-4b36-8a02-79aba60547b9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.335015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199799-622d-4b36-8a02-79aba60547b9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.335124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199799-622d-4b36-8a02-79aba60547b9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.336776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 342/705] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:20.339384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:20.344039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.344212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312515d3-8ea6-46b4-8e13-b0bd2cd4b818 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.344418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.344618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.374401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:20.377215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:20.390052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.390682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.390958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.391230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.406285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.407755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:20.424075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:20.425155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:20.426622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:20.426622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:20.426622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:20.426622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 364/706] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:20.431754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:20.517880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 343/707] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:20.548653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a28e-1c17-4a13-98a3-46d9771f8d86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.586504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.587037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.587370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.587653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.588322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:20.588628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.590067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.604820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 365/708] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:20.613197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:20.747063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00653e2-f022-4a2c-95fb-77f4ab9f0cb3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.768865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:20.796892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.797771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.798252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.798795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.807527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.808995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:20.825429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:20.826449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:20.827381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:20.829639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 344/709] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:20.835522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:20.866105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:20.875215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:21.018506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d3f2a-9d4f-4e69-9c88-dd9d3e876814 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:21.070556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41293257-290b-4211-8738-361a7285a3e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:21.085300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:21.086014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.086291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.086564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.087363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:21.087668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:21.089383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:21.123864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 366/710] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:21.130052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:21.137927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:21.138612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.138896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.139164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.139746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:21.141201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:21.162650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:21.163728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:21.164604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:21.171949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 345/711] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:21.182751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:21.224775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:21.263439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1ccd-c20f-4377-8376-d21e542d61fe None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:21.267792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:21.304844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ba491-3ab6-49a9-98f2-a4e27e6cea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:21.305501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba491-3ab6-49a9-98f2-a4e27e6cea30 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.305719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba491-3ab6-49a9-98f2-a4e27e6cea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.306000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba491-3ab6-49a9-98f2-a4e27e6cea30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.327118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37135ce-d837-4eb7-9190-33694bc535e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:21.365432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:21.366466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.366967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.367431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.368296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] RBAC: Adding query filter params (name=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:21.368796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:21.370439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52f91-3e79-4573-8c8b-608c1d300a00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:21.376533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 346/712] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:21 2022] GET /identity/v3/services?name=network => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:21.378171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4d0a-402f-4abb-9519-d39a954338f9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.378661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4d0a-402f-4abb-9519-d39a954338f9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.379731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa4d0a-402f-4abb-9519-d39a954338f9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.381991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 347/713] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:21.383078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa4d0a-402f-4abb-9519-d39a954338f9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:21.401365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ba491-3ab6-49a9-98f2-a4e27e6cea30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:21.402866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ba491-3ab6-49a9-98f2-a4e27e6cea30 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:21.479575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:21.492264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa4d0a-402f-4abb-9519-d39a954338f9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:21.502526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:21.525933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 367/714] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:45:21.527848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.528656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.529087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.529914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:21.530617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.531009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.531377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.532103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:21.532525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:21.533962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:21.548182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 348/715] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:21 2022] GET /identity/v3/services?type=network => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:21.548182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:21.572362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:21.573598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:21.734490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 368/716] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:21.768880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776a2a4-37a3-43fd-94e7-1a2edb7e46b0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:21.818695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:21.819730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.820363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.820863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.837147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:21.838602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:21.858729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:21.859804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:21.860806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:21.860806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:21.860806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:21.860806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 349/717] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:21.866486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:21.991099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:21.995616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0353-68ec-4157-9ff7-5f5deb03b8d0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.042262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.042889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.043230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.043500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.044216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:22.044521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:22.045894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:22.061883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.079314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 369/718] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:22.083477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.110852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:22.204646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f98c-f714-4256-894c-4caa3e2f8a80 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.254701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9737b-8419-4d45-8057-b62a74403365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.255266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9737b-8419-4d45-8057-b62a74403365 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.255545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9737b-8419-4d45-8057-b62a74403365 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.255815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9737b-8419-4d45-8057-b62a74403365 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.278168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9737b-8419-4d45-8057-b62a74403365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-93f9737b-8419-4d45-8057-b62a74403365 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:22.283334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:22.284504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:22.286098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 350/719] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:22.286855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915030-5f01-4c62-9817-d9e30c92bf9b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.286855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915030-5f01-4c62-9817-d9e30c92bf9b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.286993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915030-5f01-4c62-9817-d9e30c92bf9b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.288204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 351/720] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:22.293389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915030-5f01-4c62-9817-d9e30c92bf9b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.303480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f41ce-6d8a-446c-b3f9-c033e8dc0ff9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.352795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.353732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.354154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.354615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.362696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:22.365018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6f75b669-6f83-4259-881f-483e61fdb949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:22.378209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:22.379326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:22.380311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:22.382422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 370/721] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:22.383820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.384272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.384688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.404779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:22.406337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:22.411452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:22.423794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:22.433873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915030-5f01-4c62-9817-d9e30c92bf9b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.483956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.484883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.485355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.485762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.486606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:22.487115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:22.488771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:22.496209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 371/722] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:22.496209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.508052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 352/723] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:22.513797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.629132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6792b-342a-47ba-8b2e-b6bca9400201 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.674071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.674685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.674965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.675240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.676108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:22.676539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:22.678043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36442b2-7e8d-4aa5-b21b-21b46a813555 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:22.695156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 372/724] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:22.695156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bef75-0522-4d10-9c09-630d0e1172f6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.695156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bef75-0522-4d10-9c09-630d0e1172f6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.695156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bef75-0522-4d10-9c09-630d0e1172f6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.695156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 373/725] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:22.697388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bef75-0522-4d10-9c09-630d0e1172f6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.713504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:22.768075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9ecc-58de-4a7c-a8e8-f654cc746bfb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.812839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.813476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.813784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.814312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.826755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:22.828325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:22.836762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b56e487b-5ca3-4bdf-8ab3-e01c248b3c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:22.846979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:22.854293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:22.855220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:22.855220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:22.855220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:22.855220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 353/726] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:22.855443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bef75-0522-4d10-9c09-630d0e1172f6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:22.855518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.855518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.855518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.872533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:22.874933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:22.889623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:22.890341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:22.890696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:22.891062 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:22.891873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7fd5dcca78134cbcaba474e435c7fd7e) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:22.892219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:22.893673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:22.901244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 374/727] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/role_assignments?user.id=7fd5dcca78134cbcaba474e435c7fd7e&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:22.902389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:22.955042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 354/728] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:22.956274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.069755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:23.135145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d75b35-2bdf-488f-8129-63823c00844a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.167245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e5776-2513-4187-a706-2b0e072a474b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.202092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:23.213284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.214005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.214183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.214487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.215054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:23.215353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:23.216772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:23.233071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.233717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.233997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.234265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.243040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 355/729] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:23.252634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.268586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:23.274718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:23.276377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:23.278087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:23.280279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 375/730] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:23.290947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.371811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675d7d-5649-4bc3-ae0c-3b87d376f60f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.413537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.414187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.414468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.414740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.423970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:23.425657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:23.440498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:23.441633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:23.442581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 356/731] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:45:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:23.443276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.466502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daae28a-a4a4-4fef-a9ba-67913bc40870 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.506467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:23.509426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:23.513057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.514080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.514547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.514977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.515811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:23.516322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:23.517872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:23.528477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 376/732] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:23.529637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.576851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072c74-3bfa-4db1-8e43-7ee26655b0ff None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.622524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.623668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.624762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.624762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.625346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:23.628546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:23.661602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599f89b-222d-4e7a-a9b3-6fbdbe49174c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.702262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.703080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.703358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.703632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.704455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:23.704758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:23.706438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:23.718584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 357/733] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:23 2022] POST /identity/v3/services => generated 252 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:23.718584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.741504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 377/734] 10.222.0.122 () {56 vars in 1154 bytes} [Fri Aug 26 00:45:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:23.748470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.868544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:23.919253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ae35-734f-458b-91d2-e8767b882c20 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.922154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:23.928503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60cd98-de95-43e2-86c4-8801a4e75282 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.963158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.964205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.964832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.965224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.971956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.974568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.974568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.974786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.977694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:23.979500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-18a60f14-b0df-4d2d-9f2e-a48a4210c717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:23.996661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:24.004319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 358/735] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635a2a-d4cf-47a7-91a4-a2ff3db41a04 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635a2a-d4cf-47a7-91a4-a2ff3db41a04 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635a2a-d4cf-47a7-91a4-a2ff3db41a04 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 359/736] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:24.005477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635a2a-d4cf-47a7-91a4-a2ff3db41a04 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.066486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.068924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.133104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635a2a-d4cf-47a7-91a4-a2ff3db41a04 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.156527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:24.179393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.180029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.180436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.181130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.181854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:24.182544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.184308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f983c-9720-42d9-9139-8a9eae2d48a6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.200568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 360/737] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:24.202661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.203043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.203412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.209484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 378/738] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:23 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:45:24.210708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.228514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:24.230112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:24.245726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:24.326440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 361/739] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:24 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:45:24.327377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.358397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386a316-fffb-4d6a-b41b-0895ac35a2c7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.442272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b725127-1c4c-4bff-aeb7-7a917f69e36c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.460905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.461565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.461846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.462116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.481395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.482224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.482862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.482981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.483135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.483540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.496055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.497537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:24.506201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:24.507266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:24.508230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:24.508780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:24.515832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:24.517671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:24.519229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:24.519229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:24.519229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:24.519624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 379/740] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:24.519740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 362/741] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:24.522254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.522935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.554338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:24.641194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34809e7-a8fc-4ee8-a353-b6dd5e7af089 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.713347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3bb0a-44ca-4062-af46-73d7a51dd66f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.734242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.735696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.736145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.736839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.737860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:24.738833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.741255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.750626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.751239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.751514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.751783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.752757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:24.752877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.754954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.764458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 363/742] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:24.765695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.776890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 380/743] 10.222.0.122 () {56 vars in 1140 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:24.777887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:24.849837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:24.859212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:24.902722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7507-550a-4be5-b47a-f5d2e4ced6c3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.906415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4f890-a68a-4b36-9917-01cd3a26c397 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:24.948819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.949099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:24.949431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.949711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.949981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.950373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:24.950619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.950934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:24.951345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.951991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.959727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.961223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:24.973647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:24.980700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 381/744] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:24.984332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.030196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 364/745] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:24 2022] POST /identity/v3/services => generated 241 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:25.031940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.169749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e75c0-fc83-4ebb-9b8d-e94c790665f1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:25.189738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e94d1-2593-4508-8397-b423da8b371a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:25.205993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:25.208750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:25.219373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdf367-615d-4d51-a410-0dc0a2468509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:25.219373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdf367-615d-4d51-a410-0dc0a2468509 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.219373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdf367-615d-4d51-a410-0dc0a2468509 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.219373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdf367-615d-4d51-a410-0dc0a2468509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.234658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:25.235203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.235203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.235473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.236070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:25.236400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:25.238300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf788e4e-ee9a-46aa-bc00-d57fbf2e3d36 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:25.256203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 365/746] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:25.256203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d4d5e-0c9d-4443-8cd4-050c562c419b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.256203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d4d5e-0c9d-4443-8cd4-050c562c419b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.256203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d4d5e-0c9d-4443-8cd4-050c562c419b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.256203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 366/747] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:25.259667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d4d5e-0c9d-4443-8cd4-050c562c419b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.309892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdf367-615d-4d51-a410-0dc0a2468509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:25.311634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdf367-615d-4d51-a410-0dc0a2468509 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:25.392426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d4d5e-0c9d-4443-8cd4-050c562c419b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:25.433116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:25.434023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.434507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.434999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.435951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7614b7f05486411395a209e34ef5624a) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:25.436445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:25.437044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 382/748] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:24 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:45:25.438264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:25.438481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.438766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.439045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.452347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 367/749] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:25 2022] GET /identity/v3/role_assignments?user.id=7614b7f05486411395a209e34ef5624a&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:25.453817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.460109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:25.461573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:25.493146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:25.528568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:25.560910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 383/750] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:25 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:25.647560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c99b-d16b-4265-aec0-ff56306e7c2a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:25.706975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:25.707946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.708255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.708526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.721424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:25.723517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:25.740495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:25.741575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:25.743320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:25.743320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:25.743320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:25.743320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 368/751] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:25.753306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.888464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a51d4f-0a45-4a9b-8ff0-64c56e943522 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:25.939407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:25.940364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:25.940810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:25.941745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:25.942932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:25.943404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:25.944980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:25.957987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 384/752] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:25.965716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.976470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:25.999283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:26.128516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:26.134956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e8fa-b32f-4afd-87a3-1d40e490a8d2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.136556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0ccbd-a21a-4548-9869-9b4742ce608d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.174115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7675e5-c927-49d8-a3e9-02c0d87dc258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.174928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7675e5-c927-49d8-a3e9-02c0d87dc258 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.175274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7675e5-c927-49d8-a3e9-02c0d87dc258 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.176343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7675e5-c927-49d8-a3e9-02c0d87dc258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.177656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.178304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.178584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.178860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.187028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.188510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.189458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7675e5-c927-49d8-a3e9-02c0d87dc258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9c7675e5-c927-49d8-a3e9-02c0d87dc258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:26.196773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:26.197793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:26.198659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 385/753] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:26.199882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833b59f-5de7-4e88-87d3-49c387cfca30 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.199882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833b59f-5de7-4e88-87d3-49c387cfca30 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.200317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833b59f-5de7-4e88-87d3-49c387cfca30 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.205275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 386/754] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c8b22ae5-8cce-4dfb-92f5-ab41a2ad7dc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:26.205544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:26.207821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:26.210023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 369/755] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:26.211384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833b59f-5de7-4e88-87d3-49c387cfca30 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.211530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.211530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.211530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.233286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:26.235145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:26.311168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:26.316125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 370/756] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:26 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:26.317190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.351815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833b59f-5de7-4e88-87d3-49c387cfca30 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.414168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:26.416526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.417115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.417405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.417668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.418376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:26.418644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.420107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.436869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 387/757] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:26.437695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd020e75-4e67-4cf3-8139-acc0288c5cae None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.442779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.478653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.479599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.480064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.480670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.481653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:26.482139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.483854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.498354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 371/758] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:26.505626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.557792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef25d4-7d62-4273-993a-2eafaa080ab6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.593885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.594439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.594716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.594989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.607060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.608708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.614932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:26.626199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a902-b8ba-443a-9049-d5853f54190e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:26.641348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:26.642608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:26.643595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:26.643595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:26.643595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:26.643595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 388/759] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:26.648804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.679302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.681355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.683054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.683527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.685190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=42193a1473a0485787f60b5bd963e7ca) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:26.686589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.690629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.701799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 372/760] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/role_assignments?user.id=42193a1473a0485787f60b5bd963e7ca&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:26.791493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.796830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:26.812005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3b93-4528-4ade-b183-a82b4c084db9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.866528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.867736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.868710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.869630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.870575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:26.871077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.873127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.892182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 389/761] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:26.905748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:26.930374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005370b-751b-437d-8b9d-d3653bf72bea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:26.974153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:26.974972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:26.975260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:26.975535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:26.976121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:26.977524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:26.996314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:26.997660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:26.998590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 373/762] 10.222.0.122 () {56 vars in 1134 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:27.005752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.052556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:27.098896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:27.130992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6102a-bf22-45d8-aa1e-c6afca949f9b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.152179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16579c-bc59-4de0-940d-48a3324b18db None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.186877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.188035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.188550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.190097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.190966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:27.192500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.194137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.205188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 374/763] 10.222.0.122 () {56 vars in 1129 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:27.211629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.231208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.232222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.232735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.233198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.261043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.262835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:27.293544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:27.294558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:27.295503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 390/764] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:45:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:27.301860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.322309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31a028-25f7-4833-bc17-f8d4343ff645 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.353002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:27.364363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.366626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.366626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.366626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.366626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:27.366626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.367727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.380320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 375/765] 10.222.0.122 () {56 vars in 1129 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:27.384843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.517709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b538d16-45e0-412b-9fd3-3cf6421e064a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.535616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:27.551063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a1f3e-c863-45cf-b166-baafce8d0180 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.564870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.565895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.566917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.567639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.569177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:27.569980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.571911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4149d-e6e1-4daf-a158-4dc231ebe852 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.592214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.593218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.593569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.593909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.594674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] RBAC: Adding query filter params (interface=public, service_id=84c1e85a29de42a4b1736270057fe901, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:27.595093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.596508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2168e23-6dc9-4999-ba62-c82b986e2055 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.602507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 391/766] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:27.602507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b17b-c8d0-46e2-9497-8d79dfb8ab2b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.602507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b17b-c8d0-46e2-9497-8d79dfb8ab2b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.602507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b17b-c8d0-46e2-9497-8d79dfb8ab2b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.606329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 392/767] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:27.607644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b17b-c8d0-46e2-9497-8d79dfb8ab2b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.612291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 376/768] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/endpoints?service_id=84c1e85a29de42a4b1736270057fe901&interface=public®ion_id=RegionOne => generated 195 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:27.616339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.618249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.618249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.646912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:27.646912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:27.724210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:27.742188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b17b-c8d0-46e2-9497-8d79dfb8ab2b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.747825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 377/769] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:27 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:27.747825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.801873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.802569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.802919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.803163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.818352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.821333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3c3a8b95-1fa9-41f6-96c0-edb086a20192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:27.841698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:27.842887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:27.843971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:27.843971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:27.843971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:27.846032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 393/770] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:27.848825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22acb8b-750f-4799-8d4e-f9fac7fe3c79 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.849276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22acb8b-750f-4799-8d4e-f9fac7fe3c79 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.849721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22acb8b-750f-4799-8d4e-f9fac7fe3c79 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.855936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 394/771] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:27 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:27.857088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22acb8b-750f-4799-8d4e-f9fac7fe3c79 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:27.888048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:27.896629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501229-faa3-48b6-84dc-bfe054f66469 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:27.937327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c446-b7d7-48a1-a582-7e071b3c3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:27.938305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c446-b7d7-48a1-a582-7e071b3c3847 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.938573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c446-b7d7-48a1-a582-7e071b3c3847 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.938841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c446-b7d7-48a1-a582-7e071b3c3847 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.939440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c446-b7d7-48a1-a582-7e071b3c3847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:27.940838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c446-b7d7-48a1-a582-7e071b3c3847 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:27.947468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 378/772] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/services => generated 776 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:27.948586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:27.948864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:27.949133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:27.969147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:27.970846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:27.999884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22acb8b-750f-4799-8d4e-f9fac7fe3c79 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.030886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:28.050471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 379/773] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:27 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:28.052414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.079698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.080426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.080708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.081915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.083243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:28.083563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.089264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.115746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 395/774] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:28.122732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.226274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdeed1-4d0c-4d4e-9cf8-36c4ed5c974d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.256533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:28.277454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520b83-2a80-4975-8dbe-a49e39add094 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.295137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.295770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.296044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.296337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.296914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.298262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:28.315052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:28.316105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:28.317577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 380/775] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:28.325014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.358117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.358904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.359510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.359787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.369665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.371131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:28.386220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:28.387476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 396/776] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:28.389406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.396549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:28.446863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1cfd-dc4e-47a2-9cbd-1b40eae9df85 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.492645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.493242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.493519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.493819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.494559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] RBAC: Adding query filter params (name=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:28.494862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.496428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.502350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 381/777] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/services?name=network => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:28.503181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.524470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ccd6-a442-470d-8672-e70ccdf2530c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.559893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.560706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.561108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.561478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.573022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:28.578339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:28.580277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 397/778] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:28.582869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.586178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:28.630344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d7ce-45bc-46cc-9da4-5cba40dcb929 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.648429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:28.678061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.678961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.679394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.680243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.681578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:28.682207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.684145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.704182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610042-543c-4017-b04f-2dca6bbfe06b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.705626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 382/779] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:28.706954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.749696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.751270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.751270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.751270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.751657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:28.751954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.753363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.763584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 398/780] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/services?type=network => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:28.764504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.835474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:28.872318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bbf46-8a63-4a4d-86d3-00552cdc55b9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.886610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd08b-5a02-46ef-9cbf-eb595003f3e5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:28.907754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.908434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.908710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.908981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7fd5dcca78134cbcaba474e435c7fd7e/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.911464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=7fd5dcca78134cbcaba474e435c7fd7e, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.912928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.929263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:28.930172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:28.931567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:28.931567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:28.931567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:28.931823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:28.933134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:28.942595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 383/781] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:28.943782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.979579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 399/782] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:28 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7fd5dcca78134cbcaba474e435c7fd7e/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:28.981347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:28.984103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:29.113814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709da60-7602-4fe5-8a18-139c759e9bb8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:29.161309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45d5f-c183-4cfe-896b-df446dea6a41 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:29.166701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:29.167318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.167591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.167857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.169271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] RBAC: Adding query filter params (interface=public, service_id=cd6b5b92c8544ee0acf1c7e7c4c268c2, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:29.169271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:29.170454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881fba0-49ec-4945-9d3d-4a99627a6f96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:29.181498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 384/783] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/endpoints?service_id=cd6b5b92c8544ee0acf1c7e7c4c268c2&interface=public®ion_id=RegionOne => generated 195 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:29.182885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164635d-ef1f-4429-826b-51c86300e405 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.183171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164635d-ef1f-4429-826b-51c86300e405 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.183444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164635d-ef1f-4429-826b-51c86300e405 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.185044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 385/784] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:29.186186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164635d-ef1f-4429-826b-51c86300e405 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:29.204644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:29.218255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:29.219524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.219961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.220674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.236598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:29.240122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e8cec925-d66c-4fc7-b28e-732135a0e8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:29.262889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:29.264104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:29.265311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:29.265311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:29.265311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:29.268318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 400/785] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:29.270476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.270920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.271867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.296613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:29.298748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:29.321512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:29.326678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164635d-ef1f-4429-826b-51c86300e405 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:29.367242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:29.367909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.368316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.368819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.369316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:29.370917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:29.378554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 386/786] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:29 2022] GET /identity/v3/services => generated 776 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:29.380623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:29.399131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 401/787] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:29 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:29.555487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b44c3-ac32-4949-a8f9-08f496ebf5bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:29.600720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:29.601407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.601687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.601959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.602715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:29.603018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:29.604957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:29.620635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 387/788] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:29.626136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:29.743944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f419-a597-4239-9adc-0c958cb8bd25 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:29.759126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:29.772316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:29.784707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:29.786156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:29.786480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:29.786795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:29.795221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:29.796736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:29.815784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:29.817041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:29.817992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:29.818548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 402/789] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:45:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:29.822880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:29.841804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:29.991679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae35d-a56a-4b85-961d-dfff5b05f567 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.012268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1ff7f-6f6e-40ba-a1a2-9bce5838693c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.058070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.058682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.058989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.059285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.060868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:30.061177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:30.062616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:30.083930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.085037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.085447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.085931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.122693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 403/790] 10.222.0.122 () {56 vars in 1154 bytes} [Fri Aug 26 00:45:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:30.126041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:30.136431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:30.137417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:30.138263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:30.139486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.151302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 388/791] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:30.157456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.200541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:30.271582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:30.291282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2717f-a9d9-41a7-a056-b13f462a74d6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.303165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0adc5-15cc-4949-84bc-c4a0d73912b9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.337243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.338067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.338756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.339038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.340070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:30.340426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:30.342612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c8b88-36a9-4de9-876e-53d35117d6e3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:30.351184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.352132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.352635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.353206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.353982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 389/792] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:30.355253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6ad5b-458b-4ec6-8deb-ce0ba8c75a18 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.355540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6ad5b-458b-4ec6-8deb-ce0ba8c75a18 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.355816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6ad5b-458b-4ec6-8deb-ce0ba8c75a18 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.360734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 390/793] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:30.362867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6ad5b-458b-4ec6-8deb-ce0ba8c75a18 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.371567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:30.373104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-be24681c-0998-4ec7-aa9c-977ca267f1d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:30.393002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:30.394033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:30.396069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:30.396069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:30.396069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:30.396069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 404/794] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:30.396638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.396798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.397065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.421270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:30.422909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:30.496620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6ad5b-458b-4ec6-8deb-ce0ba8c75a18 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.524370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 405/795] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:30 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:30.525770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.547923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.548618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.548897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.549170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.550197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:30.577144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:30.578725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:30.592557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:30.622669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:30.623693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:30.625910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:30.625910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:30.625910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:30.625910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 391/796] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:30.631525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.746365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326dc6-798f-4d97-baa9-fe016f64a7fd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.814775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.815431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.815712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.815984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.817591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:30.820669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:30.825570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:30.838588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d659d-5a16-4277-bea0-3a0c02ab0230 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.841344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 406/797] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:30.842691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.886375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:30.887384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:30.887955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:30.888457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:30.889441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:30.889973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:30.891630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:30.908090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 392/798] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:30.909624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:30.943147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:30.986177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a04f39-149d-4a51-996f-3da24ae9883f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:30.992133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.034021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.034741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.035035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.035314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.035988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.039024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.049144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d487c-b89f-4e9b-9175-f2db9ec36476 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:31.058888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:31.059973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:31.065120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 407/799] 10.222.0.122 () {56 vars in 1134 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:31.066645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.111310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.112069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.112404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.112678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.123707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.125428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:31.142920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:31.143887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 393/800] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:31.145349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.192858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ce42-d11b-4ad4-8bf9-0838c83396de None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.235121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.236295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.236777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.237353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.242612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.256104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.257729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:31.271365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:31.272604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:31.273745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:31.275659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 408/801] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:31.276731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.286903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16f58-1dee-4953-8d16-3a34c1b0f6f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.306312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.325720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.326816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.327173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.327483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.328197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:31.328889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.330639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.342068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 394/802] 10.222.0.122 () {56 vars in 1129 bytes} [Fri Aug 26 00:45:31 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:31.343013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.398945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d1a44-7ecc-42d7-b4da-5291153c8b1d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.442916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.443846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.444261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.444976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.445931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:31.446322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.448232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed144-4600-43b1-856e-321fdd00222d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.453909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ebe4c-a816-4efd-b1ed-baf5017ad53b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.469318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 409/803] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:31.469318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640356-505f-4fbf-ac6c-96b847ba0c8d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.469318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640356-505f-4fbf-ac6c-96b847ba0c8d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.469318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640356-505f-4fbf-ac6c-96b847ba0c8d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.473063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 410/804] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:31 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:31.474040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640356-505f-4fbf-ac6c-96b847ba0c8d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.496749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.497362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.497638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.497905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.498625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:31.498930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.500637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.527118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 395/805] 10.222.0.122 () {56 vars in 1140 bytes} [Fri Aug 26 00:45:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:31.527118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.538268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.575051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.594207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640356-505f-4fbf-ac6c-96b847ba0c8d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.637136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.637751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.638029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.638462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.639438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:31.639750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.641443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabe4b8-0a2f-4f86-86f0-e8ee4e521d6e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.641907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f86f8-1625-4d15-ab54-14b24680c62d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.647579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 411/806] 10.222.0.122 () {56 vars in 1129 bytes} [Fri Aug 26 00:45:31 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:31.648903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.649184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.649458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.668819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:31.670011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:31.685676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:31.686343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:31.686622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:31.686902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7614b7f05486411395a209e34ef5624a/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:31.706581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=7614b7f05486411395a209e34ef5624a, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:31.708983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:31.749145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 412/807] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:31 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:31.750002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.801800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 396/808] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:31 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7614b7f05486411395a209e34ef5624a/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:31.803114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:31.827444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.912959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb73638-2e1b-4378-ae80-36c18a6b7fe6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:31.938675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:31.954463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f411-b24e-4177-b075-ce6fd20730e1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.007348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd793494-27c0-47d3-b50e-c02be1c360f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.008391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793494-27c0-47d3-b50e-c02be1c360f7 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.008892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793494-27c0-47d3-b50e-c02be1c360f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.009580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793494-27c0-47d3-b50e-c02be1c360f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.010498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd793494-27c0-47d3-b50e-c02be1c360f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:32.012140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd793494-27c0-47d3-b50e-c02be1c360f7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:32.095614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.096379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.096719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.097059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.108708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:32.110182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:32.128206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 397/809] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:45:31 2022] POST /identity/v3/endpoints => generated 348 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:32.128693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f34ee0-fa99-42aa-9220-19da11e20da5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.129593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f34ee0-fa99-42aa-9220-19da11e20da5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.130443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f34ee0-fa99-42aa-9220-19da11e20da5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.132292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 398/810] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:32 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:32.133127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f34ee0-fa99-42aa-9220-19da11e20da5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e41950da-cb9e-4fd8-b067-f9685bc238d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:32.140186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:32.141210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 413/811] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.142198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.172944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:32.174843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:32.281189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f34ee0-fa99-42aa-9220-19da11e20da5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.284298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 414/812] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:32 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:32.286044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.329118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:32.330475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.331145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.331428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.331807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.347260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:32.352476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:32.353450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:32.354282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 399/813] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:32.355318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:32.359830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.417567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb86a-67b5-4276-ac97-4021e6f26813 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.461963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.463188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.463577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.463939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.464765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:32.465412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:32.467198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:32.483669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 415/814] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:32.491236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.504667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2813349-c8d6-4dad-9c38-9ccb6314f464 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.582342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.587812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.588667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.589498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.590960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:32.591678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:32.598872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:32.624726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 400/815] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:32.629336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.672588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:32.679688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a599c1-eb55-4693-bee1-54ab29ba769b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.723854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.724535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.724836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.725220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.733924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:32.735912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:32.750628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:32.752698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 416/816] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:32.755040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.762894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:32.844012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c99475-ed33-44f1-8b49-63e600baeb8b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.887106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.887860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.888226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.888590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:32.889534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:32.891025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:32.906948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:32.909345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:32.912035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 401/817] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:32.915099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:32.939150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954cce3-d255-4eac-b399-6196b1f57b30 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:32.985987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:32.986648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:32.986990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:32.987323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.004527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.006109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:33.025030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:33.027509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:33.029768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:33.029768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:33.029768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:33.029768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 417/818] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:33.029768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.030575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.088054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a497a-2a0c-4b77-8c16-037adc1be635 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.134383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.148851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.150681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.151450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.152254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.153916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:33.154887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.158330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.166807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868c48-b1c6-4b55-afc6-bd48014ed962 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.177346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 402/819] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:33.178867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.215589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.216360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.216683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.216958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.217584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] RBAC: Adding query filter params (name=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:33.217939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.228367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.237156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 418/820] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:33 2022] GET /identity/v3/services?name=network => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:33.238564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.341860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.344941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d744-0b85-4285-af02-c74cbb42190b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.385671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.387143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.387670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.388143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.389013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:33.389544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.391122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.403447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccdb24-3707-4241-9f7e-24f0ed87c254 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.405814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 403/821] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:33.406990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.441653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.443060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.443566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.444039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/42193a1473a0485787f60b5bd963e7ca/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.446360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=42193a1473a0485787f60b5bd963e7ca, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.448130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.467445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.523307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa5b6b-01a2-4fbe-845c-8e8943a262cb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.554371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 419/822] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:33 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/42193a1473a0485787f60b5bd963e7ca/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:33.556198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.585743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.586379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.586656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.586927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.587573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] RBAC: Adding query filter params (type=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:33.587863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.589326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.601863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 404/823] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:33 2022] GET /identity/v3/services?type=network => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:33.607367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.716404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14bd62-86b0-4b5e-a161-373ebdc09d43 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.751465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.763498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.764539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.766965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.766965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.776909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.779004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:33.797141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:33.798201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:45:33.799167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:33.802759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 420/824] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:45:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:33.815152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.871349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ba0d-d162-4811-bc3c-0427d14ca1ce None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.886675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.920860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134851ae-b0ab-40c3-a2bc-df10005aeeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.921885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134851ae-b0ab-40c3-a2bc-df10005aeeaf None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.922373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134851ae-b0ab-40c3-a2bc-df10005aeeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.922836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134851ae-b0ab-40c3-a2bc-df10005aeeaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.923968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134851ae-b0ab-40c3-a2bc-df10005aeeaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.925517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134851ae-b0ab-40c3-a2bc-df10005aeeaf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.959632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be810-006b-44cd-b8d9-599732ede6da None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.001139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 405/825] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:45:33 2022] POST /identity/v3/endpoints => generated 339 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:45:34.001139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0346c36-86d8-44bf-9ba2-b58100bde3d7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.001139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0346c36-86d8-44bf-9ba2-b58100bde3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.001139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0346c36-86d8-44bf-9ba2-b58100bde3d7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.001546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 406/826] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:34.008086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467b0d-2751-42a2-81e9-0f3188bca403 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.008478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467b0d-2751-42a2-81e9-0f3188bca403 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.008827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467b0d-2751-42a2-81e9-0f3188bca403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.028468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.029377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.029895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.031255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.032411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:34.032902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.034684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.045344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1e467b0d-2751-42a2-81e9-0f3188bca403 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:34.050147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1e467b0d-2751-42a2-81e9-0f3188bca403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:34.072211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 421/827] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:45:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:34.077647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.178824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.185965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 407/828] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:34 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:34.250458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493819ed-125a-4249-8a28-66bc50f4b1f9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.293613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.294508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.294973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.295443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.374176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.376215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.429798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.473187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf51-ec44-43bc-84b9-b853251eafb8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.473959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf51-ec44-43bc-84b9-b853251eafb8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.473959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf51-ec44-43bc-84b9-b853251eafb8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.475396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 408/829] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:34.480804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.481397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.481872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.501540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 422/830] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:34 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:45:34.508215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:34.508402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.509992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:34.601095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 409/831] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:34 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:34.604573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.633084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.659031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff67b2-13db-4675-80cd-9191c736f242 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.698580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.705346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.705821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.706244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.718398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.721031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.723376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:34.741136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:34.742139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:34.743038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:34.743038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:34.743038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:34.743038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 423/832] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:34.748102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.758848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26f7d-c67c-40d4-9dcc-bdd27da86349 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.804200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.804200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.804200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.804574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.817927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:34.822852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:34.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:34.824742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 410/833] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:34.830762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.899933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5025-aaa1-4c67-8f1c-fd1a87f72469 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.936320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.946796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.947404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.947682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.947961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.952627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:34.952627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.952627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.955050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d9571-eb2d-4c69-a7ea-1b9c6df22c91 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.963495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 424/834] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:34.964405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.001539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.002455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.002913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.003195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.003906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.004244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.005790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.014925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 411/835] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:45:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.015801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.032520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.089446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ed87-f783-4c79-b3a2-e7bdedede591 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.129719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343fb2-5269-4d35-b792-4305fbd21c86 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.132419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.133082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.133358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.133627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.134205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.135575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:35.145375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:35.146643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:35.147511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 425/836] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:35.148470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.170125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.170680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.170965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.171240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.178899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.180380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:35.193778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:35.194903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:35.195993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:35.199764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 412/837] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:35.200698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.213871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.267170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa477-54ac-4f47-adcd-6b49ff4972d1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.286183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.304535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.305200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.305472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.305739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.317227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.319046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.319921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847154-4236-4973-bf00-0d60bfd4f1d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:35.334829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:35.335869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:35.336805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:35.336805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:35.336805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:35.336805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 426/838] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:35.336805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.367290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.367981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.368299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.368637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.369252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.369555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.370931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.376143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 413/839] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.376995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.454293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643db08-bbfd-403f-a74b-c3951986d36b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.461539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.494785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7cfe-aff2-4694-be8c-81050ee8c4f5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.495503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.495758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.496033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.496331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.497771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.497771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.498740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.520207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 427/840] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.520207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.544568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.544986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.545178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.545458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.545787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.546364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.546663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.548195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.560937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 414/841] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.561881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.629093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9a10-2c4f-4cb0-ac10-c241e17fb165 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.670122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.670747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.671020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.671297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.672256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.672256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.673640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.678751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 428/842] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.679496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.691613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d385-18f3-4742-bb5a-371fa15c6dcb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.741529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.747315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.747952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.748266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.748542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.749310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7fd5dcca78134cbcaba474e435c7fd7e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.749620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.751517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e3be-a5b2-480d-b9d2-e7bef6ed29d6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.766824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 415/843] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/role_assignments?user.id=7fd5dcca78134cbcaba474e435c7fd7e&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.806955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de954-e06f-490d-aec9-a8c21e2d4516 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.807333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de954-e06f-490d-aec9-a8c21e2d4516 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.807535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de954-e06f-490d-aec9-a8c21e2d4516 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.809412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 416/844] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:35.818603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.819072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.819553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.829721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.840631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e17eeb-b34f-4bb6-81a4-713b9497b28b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.844964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:35.846669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:35.888642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.889302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.889583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.890311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.901488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.902984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:35.921294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:35.922296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:35.923233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:35.923769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 429/845] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:35.929079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.943219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 417/846] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:36.054974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9c6fb-1aa9-427c-b8f1-f9bdd853d15e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.094520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.095143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.095420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.095691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.096452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:36.096753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.098655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.119304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 430/847] 10.222.0.122 () {56 vars in 1154 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:36.124674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.230857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.242146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b069bdd-72ac-4c49-a0ce-440a9a88067a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.244703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.279540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.291058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.291843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.292132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.292434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.353387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4cb05-c635-4be4-b967-be3e28fb6f1e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.372789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.374339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.396108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.396923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.397302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.397672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.410026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:36.415713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:36.417562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:45:36.419647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:36.428184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 431/848] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:36.428184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.488296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 418/849] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:45:36.497497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.511876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.536834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.545484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f020b25-e645-4b47-adef-6ae92c4db2be None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.585686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.586296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.586579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.586851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.587516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:36.587817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.589285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.604115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 432/850] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:36.606273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.636726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5c5cf-dae7-481f-9f8e-1de27b6ecaf5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.674241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.674883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.675685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.676144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.687526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.689104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:36.708833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:36.709819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:36.711162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:36.711162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:36.711162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:36.715016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 419/851] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:36.716000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.746927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf34df-72d0-419c-aa2f-5cad4b135a04 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.788990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.796858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.797789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.798270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.798760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.806796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.814924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.817728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.832777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4479f8-b0bf-43be-af74-9c31a03dbf73 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:36.839072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:36.840049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:36.840973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:36.840973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:36.840973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:36.843086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 433/852] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:36.849536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.877799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.879381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.879654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.880053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.880831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:36.881242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.882751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.901061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 420/853] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:36.902457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.991833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3866-0bc5-4f80-8ca0-8523c40b3f86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.016676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37038c2d-200e-4625-ac7d-36a27ef53c26 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.042281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.043334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.043759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.044533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.045598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:37.046130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.048215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.060824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.061685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.062362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.062815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.069952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 434/854] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:37.072526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.077245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.079947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.085230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:37.104137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:37.105110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:37.106090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:37.109062 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 421/855] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:37.115315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.140366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:37.203308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2939c2-0f77-4d3d-a529-93065a76742f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.247686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.248413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.248641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.248914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.257965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.260185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.263833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c400c3-6626-4d18-96d7-ca353b49d092 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:37.273643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:37.274678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:45:37.275621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:37.279760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 435/856] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:37.281028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.313566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.315115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.315579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.317273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.318158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:37.318850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.321198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.345951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 422/857] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:37.347170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.413209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6dd9e-ede8-4d53-a091-9219112d479c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.417066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:37.433009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:37.469122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.470238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.470573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.471001 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.472997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:37.473482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.476281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.491018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f67239-57db-4b48-babd-80ba430f94d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.507848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 436/858] 10.222.0.122 () {56 vars in 1140 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:37.517223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.544284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.546151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.546622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.547072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.548315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7614b7f05486411395a209e34ef5624a) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:37.548813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.550953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dffe02-8f21-4265-af4a-643d9ca53918 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.559359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 423/859] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/role_assignments?user.id=7614b7f05486411395a209e34ef5624a&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:37.656813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29a563-8554-449b-9845-e311d6bb3e5e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.699473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.700430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.700897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.701358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.736829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f8ef8-79cd-47e6-a923-38d745aa8bb0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.737161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f8ef8-79cd-47e6-a923-38d745aa8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.737387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f8ef8-79cd-47e6-a923-38d745aa8bb0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.740943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 424/860] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:37.741994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:37.749638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d660-a294-4274-9198-d5fea06157a1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.750219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d660-a294-4274-9198-d5fea06157a1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.750710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d660-a294-4274-9198-d5fea06157a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.779149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0253d660-a294-4274-9198-d5fea06157a1 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:37.780454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0253d660-a294-4274-9198-d5fea06157a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:37.805723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.807471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.883138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 425/861] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:37 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:37.917169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58151d16-8923-4f2b-81ed-d93268c3641f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.917460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58151d16-8923-4f2b-81ed-d93268c3641f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.917734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58151d16-8923-4f2b-81ed-d93268c3641f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.919317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 426/862] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:37.924450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.924763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.925019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.934262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 437/863] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:45:37.939883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.950455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:37.952417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:38.011710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.020245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.045177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 427/864] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:37 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:38.059447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd09e-178e-4117-837a-b34ead688ade None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.097100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.097836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.098113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.098380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.109348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.110916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:38.129193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:38.130413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:38.131325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:38.131325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:38.131325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:38.131325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 438/865] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:38.138186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.193528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.267089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca155f-32cb-4617-87e6-0ec7150ebe09 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.310989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.312265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.312758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.313334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.314392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:38.314997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.317615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.332695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 428/866] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:38.333542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.340247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3e3de-6dc4-4364-b1ff-d0fd9153b68f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.356562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.377676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.379513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.379513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.379513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.379735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.381131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.388423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.448867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d265b4-8820-4bb0-ab3f-69ad3ed6915c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.471324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 439/867] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:38 2022] POST /identity/v3/services => generated 252 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:38.471324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.504392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.505216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.505558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.505929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.506658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.508693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:38.521633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:38.522662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:38.523566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:38.527575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 429/868] 10.222.0.122 () {56 vars in 1137 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:38.528691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.602841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d3934-6d9e-4196-9adb-767a5c621f49 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.646937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.647659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.647946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.648345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.655821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7ef12-ec3e-46cf-8880-4db6104ab089 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.657698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.658018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.659557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:38.674977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:38.676054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:38.677092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:38.677533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 440/869] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:38.683832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.712181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.712181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.712181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.712181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.712599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:38.712599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.712599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.718539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 430/870] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:38.724549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.726185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.799726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c139-3371-4347-8339-4b081bb467b5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.841384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.842185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.842685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.843225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.844753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:38.845440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.848183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:38.870534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 441/871] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:38.871972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:38.956144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47b8f0-d6e1-42ea-a9c1-501e467a4459 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.987246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d134-ad03-494b-8e5a-305bd181352e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:38.990930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:38.994040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:38.994659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:38.994934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:38.995199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:38.995829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:38.996122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:38.999154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46c14-ed32-4cdc-ab0d-f8d413f079a9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:39.012764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 431/872] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:39.030438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:39.031119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:39.031524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:39.031687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:39.032432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=42193a1473a0485787f60b5bd963e7ca) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:39.032739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:39.034233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101b439-0415-4ce3-b262-c13bf761db91 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:39.042179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 442/873] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:38 2022] GET /identity/v3/role_assignments?user.id=42193a1473a0485787f60b5bd963e7ca&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:39.860119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec5e7-db70-4db8-93cc-b5c1781396c7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:39.861156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec5e7-db70-4db8-93cc-b5c1781396c7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:39.861693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec5e7-db70-4db8-93cc-b5c1781396c7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:39.864340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 432/874] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:39.869950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:39.870812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:39.871446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:39.891067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:39.892345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:39.965567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 443/875] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:39 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:40.253087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec5e7-db70-4db8-93cc-b5c1781396c7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:40.289625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:40.367225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec5e7-db70-4db8-93cc-b5c1781396c7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:40.403332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087cd3b-6982-470b-a9f2-a6187f806a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:40.403959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087cd3b-6982-470b-a9f2-a6187f806a6f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:40.404263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087cd3b-6982-470b-a9f2-a6187f806a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:40.404533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087cd3b-6982-470b-a9f2-a6187f806a6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:40.415977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087cd3b-6982-470b-a9f2-a6187f806a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e087cd3b-6982-470b-a9f2-a6187f806a6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:40.420652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:40.421761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:45:40.422785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:40.427486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 433/876] 10.222.0.122 () {56 vars in 1125 bytes} [Fri Aug 26 00:45:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:40.428892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:40.531596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:40.544406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc525a-0c48-41a5-aa26-4c2556549633 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:40.551420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef61bc-e879-46e5-8a9c-17249dfebd38 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:40.551710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef61bc-e879-46e5-8a9c-17249dfebd38 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:40.551989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef61bc-e879-46e5-8a9c-17249dfebd38 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:40.553654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 434/877] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:40.558986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:40.559269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:40.559546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:40.582266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:40.582504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:40.582885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:40.583167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:40.583438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:40.583718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:40.584084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:40.584478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:40.585881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:40.603208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 444/878] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:45:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:40.608517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:40.666834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 435/879] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:40 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:40.738704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a546c2-f632-4212-bdcd-4144dbe1608b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:40.781864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:40.782450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:40.782731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:40.783006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:40.799919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:40.801709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:40.818803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:40.821040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:40.823112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:40.823112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:40.823112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:40.823112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 445/880] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:40.829273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:40.853511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:40.940736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906cd18-701c-4bb6-bc98-2e6fb55b7157 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:40.983050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:40.983663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:40.983944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:40.984243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:40.984886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:40.985196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:40.986561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:40.999537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 436/881] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:41.000402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.006570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.008498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.116602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.120616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8c51-e3c6-46d5-8cb4-6401d4b4205e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.136973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd586c3a-a4c3-42ce-81c5-8faa8100485d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.157369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.158007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.158282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.158554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.159129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.160824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5de84425-2085-48e7-871b-6c97652ee0f5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:41.169793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:41.170805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:41.171642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 446/882] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:41.172517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977c71-19cc-42b8-942d-7eb6c0236ba1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.172517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977c71-19cc-42b8-942d-7eb6c0236ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.173226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977c71-19cc-42b8-942d-7eb6c0236ba1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.173944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 447/883] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:41.175642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec29ef-d057-4d9c-b88f-f9aa54ce9218 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.175924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec29ef-d057-4d9c-b88f-f9aa54ce9218 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.176364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec29ef-d057-4d9c-b88f-f9aa54ce9218 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.177571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 448/884] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:41.178624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec29ef-d057-4d9c-b88f-f9aa54ce9218 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.180677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.181318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.181598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.181866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.191461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.193283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7cab5d58-40be-43a1-b397-c01fc2c71813 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:41.204707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:41.205779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 437/885] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edac93b-fd7d-436e-8481-9cb77640a936 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.208064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edac93b-fd7d-436e-8481-9cb77640a936 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.208843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edac93b-fd7d-436e-8481-9cb77640a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.225826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0edac93b-fd7d-436e-8481-9cb77640a936 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:41.227028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0edac93b-fd7d-436e-8481-9cb77640a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:41.252703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.290410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec29ef-d057-4d9c-b88f-f9aa54ce9218 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.295537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 438/886] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:41 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:41.296675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.296957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.297224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.318702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:41.320032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:41.335952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.336581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.336855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.337123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.337857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:41.338151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.339665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.349848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 449/887] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:41.350624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.387669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.400512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 439/888] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:41 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:41.400512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.495677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c981003-88b0-4654-af37-487976ddd7b9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.522874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d69e4-1874-4f4b-b2f1-faa48a1eb995 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.541846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.551351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.552422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.553361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.559595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.559595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:41.559595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.559595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.572182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.572182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.572182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.572182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.572636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:41.572636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.572636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.577677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 440/889] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:41.578693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.590586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 450/890] 10.222.0.122 () {56 vars in 1154 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:41.591553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.654558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.700073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db6ad-b54a-4a58-b01c-afc197e1cde8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.717219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa30a-bf2a-4097-b403-02adcf702f9d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.741316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.741919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.742194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.742462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.743107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.744571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.757313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.757922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.759747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.759747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.759747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] RBAC: Adding query filter params (interface=public, service_id=3ff4115fd71a480aa6a34a9dfb72ab02, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:41.759747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.760871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.768512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 451/891] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/endpoints?service_id=3ff4115fd71a480aa6a34a9dfb72ab02&interface=public®ion_id=RegionOne => generated 195 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:41.770028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.826679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.828200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 441/892] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:41 2022] POST /identity/v3/services => generated 270 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:41.828200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.885204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752b7f-3ecb-4b0b-9f6e-53fbec339d93 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.932463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.933023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.933327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.933601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.954893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7af158-20ad-442c-a880-368d0e0b8c29 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.983335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.995865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.996541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.996825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.997096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.998302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.999129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:42.009701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:42.010834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:42.011718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 442/893] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:42.012549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.036978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.038617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.090851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:42.135144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2afe-6552-4edc-9c01-241b26fcd67e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:42.150365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 452/894] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/auth/tokens => generated 1374 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:45:42.151217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.179990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:42.180910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:42.181337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:42.181751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:42.182564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.184072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.200367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 443/895] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/services => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:42.201774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.291507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:42.304705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4e2a-5738-4730-87a1-0199db7b6712 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:42.356180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772159a-5f0a-400e-9904-bc67ec26c9a9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:42.357624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:42.358236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:42.358508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:42.358777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:42.359417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:42.359717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.361124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.368007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 453/896] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:42.373947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.392692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:42.402526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:42.406234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:42.406234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:42.406234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:42.417279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.418848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:42.438160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:42.439138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:42.441285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:42.441285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:42.441285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:42.441285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 444/897] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:42.445590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.497288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fc6dc-021d-4375-ade0-dc06752adc4e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:42.539603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:42.540251 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:42.540526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:42.540858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:42.541490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:42.541843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.543281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.548666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 454/898] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:42.564247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6028-bc75-42a1-a1b9-8ced6e5bf3b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:42.568121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:42.608831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:42.609544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:42.609827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:42.610101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:42.610764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:42.611066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.613318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.629899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 445/899] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:42.637356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.741454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:42.766333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068de332-a46e-4553-bc27-cb3a86f2b4b2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:42.807458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:42.808597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:42.809135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:42.809663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:42.818292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:42.820772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:42.838658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:42.840084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:42.841529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:42.845045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 455/900] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:42.852230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:42.966594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36f7e1-c71f-4c57-acdb-ca0007d79e2e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:43.005205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:43.006185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:43.006706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:43.007197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:43.008134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:43.008673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:43.010426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3547bf-37fd-46ec-b759-2b940a67bdfc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:43.024757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 446/901] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:43.031009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:43.149667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978baf-baa7-4be4-9bf6-9e5c90c31645 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:43.186403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:43.187048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:43.187323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:43.187592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:43.188357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] RBAC: Adding query filter params (role.id=3430c7361a1c47a3846aa5771472cec6, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7614b7f05486411395a209e34ef5624a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:43.188660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:43.190099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6fb5d-78f3-4778-9a36-c7605ea028c5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:43.194571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:43.203195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 456/902] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:43 2022] GET /identity/v3/role_assignments?user.id=7614b7f05486411395a209e34ef5624a&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=3430c7361a1c47a3846aa5771472cec6 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:44.226177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b213d-960d-4c7b-ac8a-11d996a4d341 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.226740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b213d-960d-4c7b-ac8a-11d996a4d341 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.226740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b213d-960d-4c7b-ac8a-11d996a4d341 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.228265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 447/903] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:44.234428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453a2e-dab4-4285-9a34-911cfb707c77 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.234941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453a2e-dab4-4285-9a34-911cfb707c77 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.235027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453a2e-dab4-4285-9a34-911cfb707c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.256513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-79453a2e-dab4-4285-9a34-911cfb707c77 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:44.257762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-79453a2e-dab4-4285-9a34-911cfb707c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:44.337598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 457/904] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:44 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:44.362752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357b991-834f-481c-9fe4-de03b317ddaa None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.363157 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357b991-834f-481c-9fe4-de03b317ddaa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.363523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357b991-834f-481c-9fe4-de03b317ddaa None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.365284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 448/905] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:44.370864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7c3f-7e44-4623-8795-7fc1bb554162 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.371146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7c3f-7e44-4623-8795-7fc1bb554162 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.371420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7c3f-7e44-4623-8795-7fc1bb554162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.396674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-babb7c3f-7e44-4623-8795-7fc1bb554162 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:44.397883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-babb7c3f-7e44-4623-8795-7fc1bb554162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:44.500745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 458/906] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:44 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:44.716107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12cff-ca25-443c-8d87-4c15249b4a42 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.716487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12cff-ca25-443c-8d87-4c15249b4a42 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.716762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12cff-ca25-443c-8d87-4c15249b4a42 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.718350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 449/907] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:44.724317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.724603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.724880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.743765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:44.744902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12cff-ca25-443c-8d87-4c15249b4a42 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:44.745089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:44.775812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:44.816124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:44.828604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 459/908] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:44 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:44.873879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12cff-ca25-443c-8d87-4c15249b4a42 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:44.910556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:44.911197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.911470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.911773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.912383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:44.913892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:44.918472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:44.925531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:44.926537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:44.927484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 450/909] 10.222.0.122 () {56 vars in 1137 bytes} [Fri Aug 26 00:45:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:44.936021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.055955 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3f5d6-1287-4a8f-96d2-8de1de360586 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.060710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.076002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfaeda-8b5c-4a93-b1a2-d388cf7bc5e9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.102378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.103414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.103939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.104531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.105689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.108303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:45.121456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:45.122755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:45:45.123778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:45.132190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.132190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.132190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.132190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.132649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:45.132649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.132649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.133436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 460/910] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:45.134640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.138665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 451/911] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:44 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:45.141376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.204828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.265990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417205af-414b-4872-8ebf-6f9c2f8ebae9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.285827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fba4ed-14ef-4504-98ca-b3836c578967 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.307411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f570f53-fc58-4871-80e2-19dbd68b5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.307874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f570f53-fc58-4871-80e2-19dbd68b5fcb None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.308148 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f570f53-fc58-4871-80e2-19dbd68b5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.308443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f570f53-fc58-4871-80e2-19dbd68b5fcb None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.309091 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f570f53-fc58-4871-80e2-19dbd68b5fcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.310586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f570f53-fc58-4871-80e2-19dbd68b5fcb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.326162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.326782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.329692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.329692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.329692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:45.329692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.329692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.334827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 452/912] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:45.335695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.355521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.392642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 461/913] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:45.394132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30231c4e-f04f-4e8a-abde-81cc340ca760 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.394522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30231c4e-f04f-4e8a-abde-81cc340ca760 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.394742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30231c4e-f04f-4e8a-abde-81cc340ca760 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.396435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 462/914] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:45.397745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30231c4e-f04f-4e8a-abde-81cc340ca760 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.464169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23ea8-f882-426c-bdf0-6aab66850917 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.512382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.513197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.513452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.513785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.514544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:45.514904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.516476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f26860-e53b-40f4-b72e-b9b51c9c1d5c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.523487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 453/915] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:45.523836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.524025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.524323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.544424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:45.545802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:45.553431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30231c4e-f04f-4e8a-abde-81cc340ca760 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.572216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.599172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.599798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.600079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.600381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.601038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:45.601335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.602858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.611443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 463/916] 10.222.0.122 () {56 vars in 1119 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:45.613505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.636982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 454/917] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:45.638008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.652651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.746968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff11c8-e66f-438c-a618-ea70e6ad50cc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.786614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd4f24-5520-455b-87c4-3bc0ea552b2f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.794064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.795156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.796666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.797498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.800950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] RBAC: Adding query filter params (interface=public, service_id=0f7a22a624a541ef98111ade314c4aea, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:45.802214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.806613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.814684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 464/918] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/endpoints?service_id=0f7a22a624a541ef98111ade314c4aea&interface=public®ion_id=RegionOne => generated 195 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:45.824341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.834116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.834893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.835297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.835661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.837079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.838655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.877252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.931537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 455/919] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/endpoints => generated 348 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:45.932589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.963232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a6884-05ef-4dd9-9586-2a53d6009e51 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.023098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:46.030940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.032026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.032766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.033321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.034196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.036931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.047575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 465/920] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/services => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:46.093875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed2d1-a54c-4c10-8469-695d1583bd49 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.145123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.146970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.147836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.148720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.165754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:46.174133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:46.176836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:45:46.178808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:46.181957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 456/921] 10.222.0.122 () {56 vars in 1125 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:46.187986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.311460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d1bef-369b-47a2-8cc7-ca44ed176c86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.313992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:46.351190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.351720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.351993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.352348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.353013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:46.353311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.354753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.364833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 466/922] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:46.370541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.481285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384a2d-7e1c-4ed2-8beb-dff0690ee8f0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.507180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:46.520858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.521506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.521789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.522060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.535022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.536870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:46.553491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:46.554779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:46.555688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:46.555688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:46.555688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:46.555688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 457/923] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:46.560603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.686855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b4689-0c31-474b-b505-d4ded64214d4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.732053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.733070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.733543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.734050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.734868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:46.735344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.737014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.759718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 467/924] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:46.762699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.888911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef8fa-9fee-4380-a2a3-2f00440f3542 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.935502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.936135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.936455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.936948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.945948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.947391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:46.959666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:46.960863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:46.962269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 458/925] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:46.969648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.998414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:47.084290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5569b-1a31-41a7-96aa-d04233faa2f7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:47.122430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:47.123048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.123350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.123648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.124402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:47.124953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:47.126386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:47.147477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 468/926] 10.222.0.122 () {56 vars in 1154 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:47.153459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:47.200356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:47.276614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c98cf5-f04e-4170-a622-1333fe662c22 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:47.318179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:47.318928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.319211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.319485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.332434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:47.333935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0588b135-0353-48fa-ba38-5bf57b2abbc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:47.350765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:47.351952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:47.352897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:47.352897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:47.352897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:47.352897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 459/927] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:47.361044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:47.514538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:47.546823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a209-5c4d-4b41-8b63-663b795cfb1a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:47.608719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48791-a65c-4479-b7cf-7793cbfd2921 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.609721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48791-a65c-4479-b7cf-7793cbfd2921 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.610213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48791-a65c-4479-b7cf-7793cbfd2921 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.610634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:47.611664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.612208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.612710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.613271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 460/928] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:47.616186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:47.616186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:47.617733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:47.619323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.621319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.621319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.638792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:47.640007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:47.644297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 469/929] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:47.650310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:47.738865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 461/930] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:47 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:47.782664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578c23-0b40-4772-875c-ed5a95d52bff None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:47.823404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:47.824049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.824389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.824668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.832797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:47.834325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:47.846751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:47.847683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:47.849085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 470/931] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:47.856201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:47.880084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:47.982944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e792-7258-412d-97ee-c6f813bd281e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.019271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.020305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.020932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.021408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.022339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:48.022896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.024600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.027991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.035765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:48.040207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 462/932] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:48.044674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.134095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:48.158153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb817-18bd-424e-b979-7f8a0c97a5ad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.177786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419e0bb-1718-4ea7-8d7f-222d6a8fb142 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.195072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeec6c-5e74-443e-a859-01052c0d85c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.196042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeec6c-5e74-443e-a859-01052c0d85c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.196520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeec6c-5e74-443e-a859-01052c0d85c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.196996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeec6c-5e74-443e-a859-01052c0d85c1 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7614b7f05486411395a209e34ef5624a/roles/3430c7361a1c47a3846aa5771472cec6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.199587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeec6c-5e74-443e-a859-01052c0d85c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=7614b7f05486411395a209e34ef5624a, role_id=3430c7361a1c47a3846aa5771472cec6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.201269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeec6c-5e74-443e-a859-01052c0d85c1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.219154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.221836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.221836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.221836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.221836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.223888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:48.233365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:48.234411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:48.235303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:48.239974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 471/933] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:48.240779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.317292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 463/934] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:45:48 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7614b7f05486411395a209e34ef5624a/roles/3430c7361a1c47a3846aa5771472cec6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:45:48.319092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794269-7f56-4e74-901d-b43c05722459 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.319381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794269-7f56-4e74-901d-b43c05722459 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.319663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794269-7f56-4e74-901d-b43c05722459 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.321656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 464/935] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:48.323375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:48.329856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf78b1-cc28-4ea1-b3ef-3761179c8221 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.330205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf78b1-cc28-4ea1-b3ef-3761179c8221 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.330473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf78b1-cc28-4ea1-b3ef-3761179c8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.372626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7c672-14dd-4ef3-9577-a269b518b75b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.373168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3cbf78b1-cc28-4ea1-b3ef-3761179c8221 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:48.375215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3cbf78b1-cc28-4ea1-b3ef-3761179c8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:48.422139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.422764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.423049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.423321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.424057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:48.424388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.426570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4d91c-12ba-40b6-b9dd-51b3b3efd158 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.432214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 472/936] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:48 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:48.433504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3518bc-7d02-4b19-81bc-a3f9b2763766 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.433844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3518bc-7d02-4b19-81bc-a3f9b2763766 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.434225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3518bc-7d02-4b19-81bc-a3f9b2763766 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.435795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 473/937] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:48.439934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3518bc-7d02-4b19-81bc-a3f9b2763766 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.478704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 465/938] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:48 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:48.480265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.480705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.481768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.503539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:48.505111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:48.574712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:48.583156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3518bc-7d02-4b19-81bc-a3f9b2763766 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.583334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 466/939] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:48 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:48.620423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:48.632401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.633452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.634027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.634561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.635586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:48.636171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.637958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.645856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 474/940] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:48 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:48.656215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.782171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85602eb-f7b4-4746-9f19-47fc64530ead None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.787678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.838104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.838655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.838934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.839208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.839927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] RBAC: Adding query filter params (interface=public, service_id=a543b775521644f4beba58afdfa10980, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:48.840268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.841675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.850216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 467/941] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:45:48 2022] GET /identity/v3/endpoints?service_id=a543b775521644f4beba58afdfa10980&interface=public®ion_id=RegionOne => generated 195 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:48.856531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:48.922746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72550456-0cca-41aa-8429-d977ef5e1141 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.931774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:48.964583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:48.965381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:48.965669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:48.966297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:48.967181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:48.968806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:48.975781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74a71-301e-4a79-a857-74c964c1c92c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:48.981263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:48.982248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:45:48.983150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:48.987540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 475/942] 10.222.0.122 () {56 vars in 1137 bytes} [Fri Aug 26 00:45:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:48.988535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:49.019772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.020479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.020799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.020975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.021743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.022889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.029428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 468/943] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:48 2022] GET /identity/v3/services => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:49.030222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:49.077753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:49.146078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad13f-ef7f-4852-9a5e-87ac4784f4f5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:49.169712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be7395-14c1-4be0-843b-bf061529eccb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:49.194383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.195006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.195289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.196202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.196202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.197713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.201172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING keystone.server.flask.common [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 00:45:49.205441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:49.225141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.230835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.230835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.230835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.230835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:49.230835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.230835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.234488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 469/944] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:49 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:49.240697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:49.288509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.sql.core [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:45:49.288509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:45:49.288509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [parameters: {'id': '56a296239b484abaa5a500b57a4d6a04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:45:49.288509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81639) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 56a296239b484abaa5a500b57a4d6a04.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 56a296239b484abaa5a500b57a4d6a04. Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:45:49.306337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 00:45:49.307248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application yield resource Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise self.value Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application session.commit() Aug 26 00:45:49.316697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:45:49.317654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:45:49.318566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:45:49.319368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [parameters: {'id': '56a296239b484abaa5a500b57a4d6a04', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:49.320265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:49.322354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 56a296239b484abaa5a500b57a4d6a04. Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 476/945] 10.222.0.122 () {60 vars in 1145 bytes} [Fri Aug 26 00:45:48 2022] POST /identity/v3/projects => generated 262 bytes in 320 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:49.325669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:49.383828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959e0d9-b3ce-4372-9ab7-e5ca255933e0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:49.430372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.431500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.432368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.433106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.433965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:49.434633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.436881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.442561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20eb5-9011-4175-8696-59043ca37bda None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:49.449209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 470/946] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:49 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:49.453262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:49.465060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:49.494540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.495338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.495715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.496239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.506420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.508879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:49.526164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:49.527452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:49.528472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 477/947] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:49.528978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:49.535711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:49.598683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d0288-781c-46d8-8cca-6edabf5e5a1a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:49.645889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc6b1-d1f6-4024-919a-819062fdddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.647133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc6b1-d1f6-4024-919a-819062fdddf0 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.647562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc6b1-d1f6-4024-919a-819062fdddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.647978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc6b1-d1f6-4024-919a-819062fdddf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.649002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc6b1-d1f6-4024-919a-819062fdddf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.651279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc6b1-d1f6-4024-919a-819062fdddf0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.670606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05f62-db8f-46d2-a107-e4cd9a03d851 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:49.713269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:49.717300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:49.717300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:49.717300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:49.717300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:49.717300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:49.717300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f104c-6d7a-4d51-b34b-e5ec61dd9a3b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:49.740013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 478/948] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:49 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:49.780582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 471/949] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:45:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:50.468974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8f14-db07-4440-9e4b-1f5f869461c1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:50.469531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8f14-db07-4440-9e4b-1f5f869461c1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:50.469841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8f14-db07-4440-9e4b-1f5f869461c1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:50.472273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 479/950] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:50.478227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:50.478501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:50.478777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:50.498726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:50.500192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:50.582202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 472/951] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:50 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:50.868422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8f14-db07-4440-9e4b-1f5f869461c1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:50.907244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:50.988741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8f14-db07-4440-9e4b-1f5f869461c1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.026685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea1354-c812-42e3-bcef-d701388ac87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.027318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1354-c812-42e3-bcef-d701388ac87d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.027595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1354-c812-42e3-bcef-d701388ac87d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.027868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1354-c812-42e3-bcef-d701388ac87d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.039586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea1354-c812-42e3-bcef-d701388ac87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-43ea1354-c812-42e3-bcef-d701388ac87d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:45:51.044502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:51.045460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:51.046749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 480/952] 10.222.0.122 () {56 vars in 1125 bytes} [Fri Aug 26 00:45:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:51.053379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.090918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:51.101976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11e4b-dc2f-498a-b60d-bec74f7e4d34 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.102259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11e4b-dc2f-498a-b60d-bec74f7e4d34 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.102535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11e4b-dc2f-498a-b60d-bec74f7e4d34 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.104166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 481/953] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:51.109285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.109566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.109843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.130057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:51.131571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:51.173743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e5909-909c-4159-884b-dd0b19c3e323 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.218849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.219636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.220015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.220458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.221813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:51.222242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.223765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.234402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 473/954] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:51.238985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 482/955] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:51 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:51.241188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.345234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:51.352924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251f58-e767-4e1a-bcc7-62be9fefa3fe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.390070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.390618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.390896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.391219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.405548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.407004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:51.422716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:51.423764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:51.426265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:51.426265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:51.426265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:51.426265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 474/956] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:51.430463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.462760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:51.522499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.555943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770dce7-0d52-4295-89e4-ed0df975ed89 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.603970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.604617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.604896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.605169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.606069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:51.606374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.608746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.626186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 483/957] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:51.632733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.646375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005beeb-dd4c-4406-b7fe-aeec23a323d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.686562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.687826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.688375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.688883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.689707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.692032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:51.703013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:51.704144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:51.705310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:51.714768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 475/958] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:51.714768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.726813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:51.733057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:51.744259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697617-88d2-4a88-bb32-027064f5d1ac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.783177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.784047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.784484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.784911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.793240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.794751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e2cc519f-6fa5-4645-b7d4-47c3862e0bd0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:51.808398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:51.809705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:45:51.810761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:51.814198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 484/959] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:51.815962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05e77-4aee-405d-901c-1c72e64120c8 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.816391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05e77-4aee-405d-901c-1c72e64120c8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.816719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05e77-4aee-405d-901c-1c72e64120c8 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.818000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 485/960] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:51.818747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05e77-4aee-405d-901c-1c72e64120c8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:51.841231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b54fc-ee46-46ed-986f-97c60af29c04 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.887923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.888900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.889184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.889458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.890109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:51.890409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.891834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1279e-97b6-49e8-b3b9-ad840a67a738 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.898154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 476/961] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:51.899415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.899694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.899961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.919814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:51.921090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:51.944698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05e77-4aee-405d-901c-1c72e64120c8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:51.983281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:51.983910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:51.984246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:51.984246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:51.984246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:51.985614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:51.987691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d53-e297-4a58-8e3c-17a1c7fba11b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:51.999848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 477/962] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:51 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:52.000728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.009871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 486/963] 10.222.0.122 () {56 vars in 1154 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:52.011031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.011520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52f27-0426-448e-bb8e-efb87023c418 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.011806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52f27-0426-448e-bb8e-efb87023c418 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.012078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52f27-0426-448e-bb8e-efb87023c418 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.016794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 487/964] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:52.016794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52f27-0426-448e-bb8e-efb87023c418 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.019037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.121124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f42a-a4dc-4aa8-9549-804d1d3ef785 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.146082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52f27-0426-448e-bb8e-efb87023c418 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.162573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.163113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.163395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.163668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.164346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:52.164651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.166028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826b227-affa-4a3a-aee9-aed230ba4476 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.174927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 478/965] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:51 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:52.176647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.176931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.177202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.194303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.195249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.195729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.196116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:52.196425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.197356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:52.269999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.282915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 479/966] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:52 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:52.282915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.290053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.290053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.291422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.383661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d449db-5ce5-444b-81e1-e0837678e832 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.403151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 488/967] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:45:52 2022] GET /identity/v3/auth/tokens => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:45:52.403987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.427043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.427589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.427870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.428147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.428850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.430218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.509187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b20b-152d-4a8f-9516-e21b8e31467b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.510931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.519427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 480/968] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:45:52 2022] POST /identity/v3/endpoints => generated 351 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:52.524512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.572281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.573939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.574538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.574989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.575793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.578179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.598508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.631845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.sql.core [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:45:52.631845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:45:52.631845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [parameters: {'user_id': '63b52d4d151c4a33922803d1af753a26', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:45:52.631845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81639) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Aug 26 00:45:52.639206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:45:52.647621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application yield resource Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise self.value Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application session.commit() Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:45:52.648634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:45:52.649569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:45:52.650483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application result.read() Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:45:52.651375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [parameters: {'user_id': '63b52d4d151c4a33922803d1af753a26', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:52.653840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 00:45:52.657311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 489/969] 10.222.0.122 () {60 vars in 1136 bytes} [Fri Aug 26 00:45:52 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:52.660227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.661298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abe5ec-eb4d-4da7-8c32-c9659d309f45 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.697768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.698324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.702039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.702039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.713425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.714902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:45:52.732493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:52.733764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:45:52.734927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:45:52.734927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:45:52.734927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:52.736472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 481/970] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:52.737854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.782034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fda2-99ae-4b4c-b2ac-c6676a59e75d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.821915 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.822878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.823206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.823476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.824088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.825720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:52.836470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:52.837675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:52.838532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 490/971] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:52.839351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.859721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1829027-77d4-4898-96c4-4185fd9394dc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.870783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.870970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:52.898833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.899610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.899952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.900328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:52.908839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:52.910626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:45:52.923182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:52.924443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:45:52.925602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:52.930650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 482/972] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:45:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:52.931611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:52.954431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e476e-947a-40a9-a7bd-958ed1b18fe5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:52.997996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:52.998719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:52.999063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:52.999649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.000415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:53.000782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.002227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.026908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 491/973] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:53.026908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:53.051529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2ea76-cb81-43c2-a407-029d3402a2ab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:53.093496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:53.094140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:53.094423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:53.094697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.095328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:53.095632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.097069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.102728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 483/974] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:52 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:53.103523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:53.130716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:53.144206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:53.147513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2c0e-089a-4f1b-a4b8-51d5aa1cb5ad None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:53.186536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:53.187287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:53.187624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:53.187950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.188742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:53.189095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.191189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.225880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818059d-d590-462d-b665-7b91c7c66c78 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:53.229785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 492/975] 10.222.0.122 () {56 vars in 1106 bytes} [Fri Aug 26 00:45:53 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:53.230591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:53.278792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:53.279447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:53.279817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:53.280212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.289183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.291028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:45:53.304763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:53.305939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:45:53.307043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:53.313546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 484/976] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:53.315658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:53.382322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02d4f-22ad-4d4c-8fa2-d88ee3dd1333 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:53.423617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:53.424295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:53.424699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:53.424948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.425704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:53.426001 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.427390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.434076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:53.436288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 493/977] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:53 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:53.448043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2db31-acbe-4728-8c23-fe73b4ad106f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:53.490002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:53.490727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:53.491105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:53.491474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.492394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:53.492813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.494487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253b95-a698-447e-a3c6-57fe721a8d96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.511134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 485/978] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:53.519175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:53.529858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:53.641833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c4bf4-78bb-4346-a9be-498301015a49 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:53.681332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:53.681947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:53.682227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:53.682498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:53.683233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] RBAC: Adding query filter params (role.id=3430c7361a1c47a3846aa5771472cec6, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7614b7f05486411395a209e34ef5624a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:53.683534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:53.684997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a01d96-590c-4f9e-a569-6654478a041e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:53.692810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 494/979] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:45:53 2022] GET /identity/v3/role_assignments?user.id=7614b7f05486411395a209e34ef5624a&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=3430c7361a1c47a3846aa5771472cec6 => generated 610 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:54.525132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9653-df52-495e-9109-e0a9b239a7ff None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:54.525665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9653-df52-495e-9109-e0a9b239a7ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:54.525665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9653-df52-495e-9109-e0a9b239a7ff None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:54.527011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 486/980] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:54.532484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6489-144d-429b-af36-650b04345b2a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:54.532745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6489-144d-429b-af36-650b04345b2a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:54.533018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6489-144d-429b-af36-650b04345b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:54.551464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-140f6489-144d-429b-af36-650b04345b2a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:54.553019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-140f6489-144d-429b-af36-650b04345b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:54.623922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:54.630305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 495/981] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:54 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:54.902819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9653-df52-495e-9109-e0a9b239a7ff None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:55.011125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9653-df52-495e-9109-e0a9b239a7ff None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:55.048415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:55.049095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.049958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.050229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.050995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:55.052372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:55.061478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:55.062490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:55.063442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 487/982] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:45:55.070858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f6489-144d-429b-af36-650b04345b2a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:55.184147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f6489-144d-429b-af36-650b04345b2a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:55.225318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:55.225951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.226224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.226490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.227133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:55.227436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:55.228894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:55.239360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 496/983] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:55 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:55.241231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:55.262531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:55.358913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a932-7f52-46f8-8ce5-58f91d33bfaa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:55.397216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:55.397843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.398125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.398399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.399045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:55.399347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:55.400797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9fce7-e984-4a51-a7ec-b31d5a7af864 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:55.408532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 488/984] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:55 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:55.412773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:55.477160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51036b-3943-4cb0-b99b-d7f771350608 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.477372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51036b-3943-4cb0-b99b-d7f771350608 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.477623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51036b-3943-4cb0-b99b-d7f771350608 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.479075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 489/985] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:55.484133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219000-cca3-4b8d-b4ce-b1b4d3f77422 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.484447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219000-cca3-4b8d-b4ce-b1b4d3f77422 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.484719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219000-cca3-4b8d-b4ce-b1b4d3f77422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.485858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:55.505137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-13219000-cca3-4b8d-b4ce-b1b4d3f77422 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:55.506345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-13219000-cca3-4b8d-b4ce-b1b4d3f77422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:55.528728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3f1aa-eaff-4ca2-b5fc-20ce776a8721 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:55.565328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:55.565945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.566218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.566792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.567196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] RBAC: Adding query filter params (interface=admin, service_id=a543b775521644f4beba58afdfa10980, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:55.567496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:55.568893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:55.574342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 497/986] 10.222.0.122 () {56 vars in 1254 bytes} [Fri Aug 26 00:45:55 2022] GET /identity/v3/endpoints?service_id=a543b775521644f4beba58afdfa10980&interface=admin®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:55.580130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:55.588272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 490/987] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:55 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:55.693131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebea7a5-12e6-4830-9269-f227230d6774 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:55.707231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1ab3-7f2b-4118-a741-fba4ea7b14c1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.707520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1ab3-7f2b-4118-a741-fba4ea7b14c1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.707790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c1ab3-7f2b-4118-a741-fba4ea7b14c1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.709305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 491/988] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:45:55.714511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.714793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.715068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.730261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:55.733727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:55.734917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:55.738307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:55.738918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:55.744429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:55.744594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:55.744594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:55.744594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:55.744594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:55.752789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 498/989] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:55 2022] GET /identity/v3/services => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:55.816396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 492/990] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:55 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:55.870827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:55.991080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff96d9-9b0b-41aa-826d-5e503bf59dab None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:56.027606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:56.028247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:56.028532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:56.028804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:56.029452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:56.030829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:56.117229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:56.141602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 499/991] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:55 2022] POST /identity/v3/services => generated 243 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:56.232286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73dc66-8f7a-4558-82a3-9576864d809c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:56.277582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:56.278122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:56.278394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:56.278656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:56.279227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:56.280609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:56.284182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:56.291666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:56.292813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:56.293904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 493/992] 10.222.0.122 () {56 vars in 1110 bytes} [Fri Aug 26 00:45:56 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:56.298808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:56.368625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:56.421433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928b12-4eb6-45df-b579-34b541a7f585 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:56.458813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:56.459431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:56.459712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:56.459985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:56.460672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:56.460987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:56.462407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c54777-260e-42c6-94cb-43e96ee339b8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:56.468011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 500/993] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:56 2022] GET /identity/v3/services?name=image => generated 123 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:56.475110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:56.581267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade79754-1bb2-4465-bd8f-a809d323f6aa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:56.616584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:56.620553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:56.620553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:56.620553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:56.620553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:56.620553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:56.620553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08965a61-c85d-4168-a56b-c9bfda66bf04 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:56.632253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 494/994] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:45:56 2022] GET /identity/v3/services?type=image => generated 123 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:57.750906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5748a71-3a8c-4904-ab74-92ce37aad8f4 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:57.751967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5748a71-3a8c-4904-ab74-92ce37aad8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:57.753123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5748a71-3a8c-4904-ab74-92ce37aad8f4 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:57.755545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 501/995] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:57 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:57.760863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92817cc6-aabf-4689-bdea-8c02565437e7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:57.761507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92817cc6-aabf-4689-bdea-8c02565437e7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:57.761507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92817cc6-aabf-4689-bdea-8c02565437e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:57.781895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-92817cc6-aabf-4689-bdea-8c02565437e7 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:57.784288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-92817cc6-aabf-4689-bdea-8c02565437e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:57.848591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:57.857795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 495/996] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:57 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:58.129032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5748a71-3a8c-4904-ab74-92ce37aad8f4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:58.154796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba002ad-d98e-4aeb-b10e-04ff19e603ff None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.155013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba002ad-d98e-4aeb-b10e-04ff19e603ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.155335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba002ad-d98e-4aeb-b10e-04ff19e603ff None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.156642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 496/997] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:58.161860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.162130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.162404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.181126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:58.182334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:58.248519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5748a71-3a8c-4904-ab74-92ce37aad8f4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:58.257367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 497/998] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:45:58.265927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:58.285790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:58.286565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.286969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.287369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.288067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:58.289629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:58.299986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:58.301535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:45:58.302614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:45:58.308484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 502/999] 10.222.0.122 () {56 vars in 1131 bytes} [Fri Aug 26 00:45:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:58.310787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:58.417593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf404b04-c2ff-494d-8c53-fa8de748868a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:58.442944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:58.454348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:58.455015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.461381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.461381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.461381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:58.461381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:58.461381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:58.468357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 498/1000] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:58 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:58.470014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:58.536777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:58.595188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0114b4-3a93-455f-a5ef-e400fe976f1c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:58.632004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:58.632638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.632910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.633175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.633798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:58.634090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:58.635449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a56b2-88b9-4bc6-a5ee-e37e4becd942 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:58.640575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 503/1001] 10.222.0.122 () {56 vars in 1127 bytes} [Fri Aug 26 00:45:58 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:58.647448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c075b-b6a1-405b-a5f9-346b58d4c482 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.647730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c075b-b6a1-405b-a5f9-346b58d4c482 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.648008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c075b-b6a1-405b-a5f9-346b58d4c482 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.649308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 504/1002] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:45:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:45:58.649988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c075b-b6a1-405b-a5f9-346b58d4c482 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:58.652526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ade8-2240-415b-96b9-76c8e8d1e410 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:58.688055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:58.688631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.688973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.689250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.690282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:58.691653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:58.702067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b9dd56f3-83f1-4128-884f-05dbe8bf31f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:45:58.702234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:45:58.703204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:45:58.704043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 499/1003] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:45:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:45:58.704912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.704912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.704912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.726229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:58.727568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:58.769665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c075b-b6a1-405b-a5f9-346b58d4c482 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:58.783401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:58.806433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 500/1004] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:45:58 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:45:58.807325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:58.819952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:58.820997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.821573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.821865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.822549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:58.823985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:58.912207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 505/1005] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:45:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:58.924895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66fce0-37e8-44b3-a403-8f47e0508759 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:58.976255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:58.976803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:58.977082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:58.977349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:58.978000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:58.978302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:58.979715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:58.985508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 501/1006] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:58 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:58.992103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:59.095850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:59.130325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f10f75-da5a-437c-a31b-e90a098e0431 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:59.133084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:59.161816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:59.167998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:59.168663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:59.168940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:59.169210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:59.169839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:59.170156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:59.171520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:59.178450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 506/1007] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:45:58 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:59.184137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:59.223364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233023db-3632-4e49-b8a6-e02948e7263d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:59.263690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672b90c-2953-4867-ae3f-28afb6c6b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:59.264249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b90c-2953-4867-ae3f-28afb6c6b72a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:59.264532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b90c-2953-4867-ae3f-28afb6c6b72a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:59.264853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b90c-2953-4867-ae3f-28afb6c6b72a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:59.265449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672b90c-2953-4867-ae3f-28afb6c6b72a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:59.266808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672b90c-2953-4867-ae3f-28afb6c6b72a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:59.302163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf600a7a-ebc1-429a-b262-e9960a43cc75 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:59.338560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:59.339169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:59.339443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:59.339710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:59.340484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] RBAC: Adding query filter params (interface=public, service_id=736704cbbb1b4b67a3fb507a5b03171a, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:59.340789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:59.342141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:59.348349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 507/1008] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:45:59 2022] GET /identity/v3/endpoints?service_id=736704cbbb1b4b67a3fb507a5b03171a&interface=public®ion_id=RegionOne => generated 195 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:59.354169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:59.387024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:59.427205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 502/1009] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:45:59 2022] POST /identity/v3/services => generated 243 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:59.467683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e182f-706e-400a-9c76-d979e1ed459a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:59.518244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5b1c-50ba-464f-afcb-ffba8ab9ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:59.518774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5b1c-50ba-464f-afcb-ffba8ab9ab82 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:59.519053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5b1c-50ba-464f-afcb-ffba8ab9ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:59.519329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5b1c-50ba-464f-afcb-ffba8ab9ab82 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:59.519940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5b1c-50ba-464f-afcb-ffba8ab9ab82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:59.521380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5b1c-50ba-464f-afcb-ffba8ab9ab82 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:59.528785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 508/1010] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:45:59 2022] GET /identity/v3/services => generated 1966 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:46:00.976530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e9897-e81d-4549-a10f-78cf988b8de9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:00.977077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e9897-e81d-4549-a10f-78cf988b8de9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:00.977077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e9897-e81d-4549-a10f-78cf988b8de9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:00.978297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 503/1011] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:00.983929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce58f3-0841-474d-8fa5-9f221fb6f490 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:00.984402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce58f3-0841-474d-8fa5-9f221fb6f490 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:00.984503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce58f3-0841-474d-8fa5-9f221fb6f490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.004003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0fce58f3-0841-474d-8fa5-9f221fb6f490 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:01.005253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0fce58f3-0841-474d-8fa5-9f221fb6f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:01.092199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 509/1012] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:00 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:01.374470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e9897-e81d-4549-a10f-78cf988b8de9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:01.410434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a386d3-0fe2-4d55-825a-7a1e812940e8 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.410721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a386d3-0fe2-4d55-825a-7a1e812940e8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.410985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a386d3-0fe2-4d55-825a-7a1e812940e8 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.412689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 510/1013] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:01.417748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb924-321a-46da-a93c-a8a4c0060307 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.418021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb924-321a-46da-a93c-a8a4c0060307 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.418289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb924-321a-46da-a93c-a8a4c0060307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.437456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6c0bb924-321a-46da-a93c-a8a4c0060307 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:01.438646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6c0bb924-321a-46da-a93c-a8a4c0060307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:01.458916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:01.498506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e9897-e81d-4549-a10f-78cf988b8de9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:01.500413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:01.515388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 511/1014] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:01 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:01.529836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051181c3-21c2-4ce7-abeb-829f448b210a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.530160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051181c3-21c2-4ce7-abeb-829f448b210a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.530398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051181c3-21c2-4ce7-abeb-829f448b210a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.531803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 512/1015] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:01.538579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.538888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.539134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.542683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:01.543393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.543676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.543944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.545078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:01.546696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:01.549419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 504/1016] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:01.554976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:01.559158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:01.560294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:01.645186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 513/1017] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:01 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:01.670611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa7eb-d1e4-4836-b355-5ddc5020fc4e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:01.712789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:01.713405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.713685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.713957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.714601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:01.716037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:01.791996 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:01.877358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:01.894719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 505/1018] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:46:01 2022] POST /identity/v3/projects => generated 312 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:46:01.898651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13803-c8f4-4d25-8a30-6276e69f2172 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:01.918081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:01.940692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:01.941357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:01.941661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:01.941911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:01.942508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:01.944033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:01.947654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:01.954752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:01.956801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:01.957683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 514/1019] 10.222.0.122 () {56 vars in 1110 bytes} [Fri Aug 26 00:46:01 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:01.964820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.039562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8aca1-b143-49b8-b6c0-d0b46030a535 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.077220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.077859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.078911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.079191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.079805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.083024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.084390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fc76-53fb-4ac9-9b1e-9af699e863f4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:02.092718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:02.093782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:02.094635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 506/1020] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:46:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:02.100015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.135526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.136501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.136956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.137433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.138065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] RBAC: Adding query filter params (name=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:02.138361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.139733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.145231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 515/1021] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:01 2022] GET /identity/v3/services?name=image => generated 123 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:02.150656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.164459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:02.195759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:02.211573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4290d-e377-46b3-807d-2a3bbcc02026 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.258080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.259314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.259615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.259894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.260608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:02.260936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.262470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.269451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 507/1022] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:46:02 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:02.269780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a877b5-580a-4f04-aaaa-1d370507ae2f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.275203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.314608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.315270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.315678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.315957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.316638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:02.316947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.318328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.323945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 516/1023] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:02 2022] GET /identity/v3/services?type=image => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:02.330449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.394246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d33f6-3dc3-414d-be01-8cb2192ec89d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.417470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:02.434596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.440261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.440261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.440261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.440261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:02.440261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.440261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.447433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 508/1024] 10.222.0.122 () {56 vars in 1117 bytes} [Fri Aug 26 00:46:02 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:02.452602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43430a-7c7d-4828-914a-3eeff470d8b6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.453446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.472518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:02.493532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.494149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.494430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.494703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.495404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] RBAC: Adding query filter params (interface=public, service_id=e857a46f978845b58592d0390c07dea1, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:02.495713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.497113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.508382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 517/1025] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:46:02 2022] GET /identity/v3/endpoints?service_id=e857a46f978845b58592d0390c07dea1&interface=public®ion_id=RegionOne => generated 195 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:02.510185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:02.561650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349befa5-49c7-4456-b5df-5d0ab6a4d36c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.596820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fcd59-a2e6-40e0-b40d-196c4dca5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.597475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fcd59-a2e6-40e0-b40d-196c4dca5ad2 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.597751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fcd59-a2e6-40e0-b40d-196c4dca5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.598020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fcd59-a2e6-40e0-b40d-196c4dca5ad2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.598676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fcd59-a2e6-40e0-b40d-196c4dca5ad2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.600027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fcd59-a2e6-40e0-b40d-196c4dca5ad2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.630592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57319-6966-4b58-94be-3d13d5103bed None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:02.671783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6758-f040-4b16-9e17-1e3d26ce95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:02.672388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6758-f040-4b16-9e17-1e3d26ce95a8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:02.672670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6758-f040-4b16-9e17-1e3d26ce95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:02.672943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6758-f040-4b16-9e17-1e3d26ce95a8 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:02.673628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6758-f040-4b16-9e17-1e3d26ce95a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:02.675513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6758-f040-4b16-9e17-1e3d26ce95a8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:02.682373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 518/1026] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:46:02 2022] GET /identity/v3/services => generated 1966 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:46:02.699284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 509/1027] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:46:02 2022] POST /identity/v3/endpoints => generated 336 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:46:04.113837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b996d-2663-440d-bb33-a0a8150a267e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.114531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b996d-2663-440d-bb33-a0a8150a267e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.114531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b996d-2663-440d-bb33-a0a8150a267e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.115990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 519/1028] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:04.121386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.121800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.121966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.140869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:04.142058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:04.210479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:04.222761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 510/1029] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:04 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:04.498818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b996d-2663-440d-bb33-a0a8150a267e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:04.502123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:04.616044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b996d-2663-440d-bb33-a0a8150a267e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:04.654572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dfff5-d3fe-40dc-af71-887fd70605f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:04.655479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dfff5-d3fe-40dc-af71-887fd70605f8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.655908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dfff5-d3fe-40dc-af71-887fd70605f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.656351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dfff5-d3fe-40dc-af71-887fd70605f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.657617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dfff5-d3fe-40dc-af71-887fd70605f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:04.659585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dfff5-d3fe-40dc-af71-887fd70605f8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:04.661675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 520/1030] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:04.667403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:04.781293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6667-6ca6-4d1d-817c-444606b11c11 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.781293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6667-6ca6-4d1d-817c-444606b11c11 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.781293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6667-6ca6-4d1d-817c-444606b11c11 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.784279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 521/1031] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:04.789411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb496ba-f6e1-46ba-abd0-e0a800108d48 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:04.791598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0f1e-12a7-4f98-97bf-0bf20ab2acfd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.792223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0f1e-12a7-4f98-97bf-0bf20ab2acfd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.792567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0f1e-12a7-4f98-97bf-0bf20ab2acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.812780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-91cb0f1e-12a7-4f98-97bf-0bf20ab2acfd None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:04.814112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-91cb0f1e-12a7-4f98-97bf-0bf20ab2acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:04.826813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:04.827425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.827817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.828093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.828778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:04.830935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:04.882609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:04.887328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 522/1032] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:04 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:04.888592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625869-49e2-4397-8ab3-422f6c1b2188 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.899434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625869-49e2-4397-8ab3-422f6c1b2188 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.899434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625869-49e2-4397-8ab3-422f6c1b2188 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.899434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 523/1033] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:04 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:04.899434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:04.899434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:04.899434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:04.915311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:04.916543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:04.963609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 511/1034] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:46:04 2022] POST /identity/v3/users => generated 286 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:05.005010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 524/1035] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:04 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:05.161598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.220334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:05.270652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7c10-0050-4d8c-bde1-ab679aafa9b3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.276670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.309709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.310335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.310610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.310879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.311454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:05.312842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:05.322692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:05.323834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:46:05.325343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:05.328588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 512/1036] 10.222.0.122 () {56 vars in 1110 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:05.330230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.385667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624a9cd-a15b-4db9-9480-7fd83ca9c242 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.419185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:05.426725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.427358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.427637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.427905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.438776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:05.443630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:05.444794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:05.445668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 525/1037] 10.222.0.122 () {56 vars in 1125 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:05.451842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.453558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ff681-d894-41db-9dc2-655d97d7a7f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.474047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:05.494117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.495109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.495701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.496236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.497074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:05.497596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:05.499418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:05.510516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 513/1038] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/services?name=image => generated 123 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:05.512049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.571281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef372-515b-4bf7-be0d-0278febaaaac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.613034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.613874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.614262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.614544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.615938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:05.615938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:05.617393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:05.631127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 526/1039] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:05.636530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.637727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643ed97-82ec-43ac-aed6-fad6f59f1820 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.678227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.678833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.679131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.679472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.680171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:05.680470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:05.681951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:05.692842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 514/1040] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/services?type=image => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:05.694475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.706580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:05.746485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:05.758717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2a52-bdd0-4e69-ab6b-d79a3078abae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.806963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.807611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.807914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.808194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.813562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b71d5-f035-4e1a-81a5-5021d57d8652 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.825131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:05.826648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:05.847881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:05.849131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:05.850051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:05.850051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:05.850051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:05.850051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 527/1041] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:05.855651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:05.866274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:05.866899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:05.867179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:05.867450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:05.868109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:05.869519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:05.974991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fddf1-1e7e-4339-a823-80ddb3ca7132 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:05.978437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:06.012659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.013277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.013557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.013829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.014479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:06.014790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.016173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.032197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 515/1042] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:46:05 2022] POST /identity/v3/endpoints => generated 329 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:46:06.039883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 528/1043] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:06.046429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:06.162220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:06.173565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202187-89aa-40ab-8c94-72cebb086086 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:06.214768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.215400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.215675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.215944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.225665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.227088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:46:06.239899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:06.240934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:06.242194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 516/1044] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:46:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:06.249179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:06.354092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e85aa-f761-40d6-865d-45a41312fe2e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:06.391624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.393111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.393407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.393680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.394415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:06.394718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.396332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.419875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 529/1045] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:46:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:06.421600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:06.533534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2977d6-2217-4a89-b3cc-dd92df11eaf3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:06.569813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.570417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.570742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.571024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.599155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:06.645734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.647179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.759215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 517/1046] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:06 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:46:06.764914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:06.792606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:06.871602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550afd4-bcef-4137-80e6-93684158cf37 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:06.907304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.908109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.908414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.908788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.919765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.921361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4c7b7a8b-555a-4abf-a58d-97b0457eea08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:06.937638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:06.938654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:06.940698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:06.940698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:06.940698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:06.940698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 530/1047] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:06.945336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.005968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.051954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa34a7-7da7-42d4-9ebf-db5989159df7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.079471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b52f-fefa-4651-ba28-7a32229cb851 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.080408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b52f-fefa-4651-ba28-7a32229cb851 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.080816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420b52f-fefa-4651-ba28-7a32229cb851 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.082384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 531/1048] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:07.088407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.088818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.088958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.098692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.099586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.100031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.100494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.101306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:07.101757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.104262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.109254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:07.110482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.121305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 518/1049] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:07.127732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.198380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 532/1050] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:07.249847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83a23c-58f3-46b3-82fe-d266ffe1442d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.271189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.291279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.291939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.292248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.292524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.301105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.302639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:46:07.317258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:07.318652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:46:07.319619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:07.320576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 519/1051] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:07.330254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.334085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.442706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d0d6-b094-44e7-9e08-355e7d26c5f7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.477960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.484565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.485260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.486118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.486448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.487256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:07.487617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.489972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.506308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 533/1052] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:07.512416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.585873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.604896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c777-1cbb-4c5c-bac1-adc6e8028c30 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.631596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14431-95e7-4ea9-9be8-257811275024 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.647097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.647648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.648003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.648370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.660839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:07.665732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:07.666976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:07.668008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:07.669422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 520/1053] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:07.675999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.676898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.677605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.677966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.678335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.679416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] RBAC: Adding query filter params (role.id=3430c7361a1c47a3846aa5771472cec6, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7fd5dcca78134cbcaba474e435c7fd7e) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:07.679821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.682614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.691097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 534/1054] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/role_assignments?user.id=7fd5dcca78134cbcaba474e435c7fd7e&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=3430c7361a1c47a3846aa5771472cec6 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:07.728803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.816230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b3b1-6a98-4198-89dd-711b6347f250 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.856485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.857020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.857337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.857611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.858274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:07.858578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.859949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.869661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 521/1055] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:07.875508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.989019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe1f8-2be3-44de-abee-88ded664fdf2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:08.017366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:08.026304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae89609-59fb-44b2-929f-7bd2e2c96d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:08.030196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae89609-59fb-44b2-929f-7bd2e2c96d27 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.030196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae89609-59fb-44b2-929f-7bd2e2c96d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.030196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae89609-59fb-44b2-929f-7bd2e2c96d27 None admin] PATH_INFO: `/v3/users/c80970b23363483f99a8118c58e87159` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.043287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae89609-59fb-44b2-929f-7bd2e2c96d27 None admin] RBAC: Authorizing `identity:get_user(user_id=c80970b23363483f99a8118c58e87159)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:08.044788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae89609-59fb-44b2-929f-7bd2e2c96d27 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:08.049096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 535/1056] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/users/c80970b23363483f99a8118c58e87159 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:08.053486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:08.085857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c81be-98f8-4cff-b5e1-b17e5f4f36ed None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.086125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c81be-98f8-4cff-b5e1-b17e5f4f36ed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.086409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c81be-98f8-4cff-b5e1-b17e5f4f36ed None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.087865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 536/1057] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:08.093917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.094216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.094475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.115801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:08.117014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:08.186839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:08.192983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f9bd-ffc6-4976-a97d-25cf4c134213 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:08.207182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 537/1058] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:08 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:08.232484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:08.233265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.233640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.234008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.310372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:08.312018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:08.417892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:08.424464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 522/1059] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:08 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:46:08.431258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:08.486039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:08.579918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32eef2-c715-4b33-9c1c-c4bd2a5ffd25 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:08.599230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:08.611945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaffab-467c-44e6-bb18-d73ac92c3517 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:08.621268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:08.622420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.622989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.623870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.625934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7d01a083194af4a28fcdedce738cb7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:08.628636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:08.632050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 538/1060] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:08 2022] GET /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:08.637361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:08.662152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:08.662865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.663322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.663845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.744197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:08.748644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:08.750101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:08.774270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae762-2194-4dfe-867d-af5997a2cbb3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:08.821667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:08.822413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:08.822709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:08.822989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:08.823870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=9e7d01a083194af4a28fcdedce738cb7, user.id=c80970b23363483f99a8118c58e87159) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:08.824216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:08.825829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:08.840767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 539/1061] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:08 2022] GET /identity/v3/role_assignments?user.id=c80970b23363483f99a8118c58e87159&scope.project.id=9e7d01a083194af4a28fcdedce738cb7&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:08.895233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 523/1062] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:08 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:46:08.901267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:08.966151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:09.030330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faffc3-c762-439c-b510-513c33572136 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:09.067882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:09.068568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:09.068843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:09.069115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:09.082273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:09.083835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-09901dd0-eb79-4a18-a932-dfb77bbed532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:09.103066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:09.104124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:09.105374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:09.105374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:09.105374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:09.105974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 540/1063] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:09.114870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:09.230587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:09.236261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d5ea-5bba-4bf3-ab3c-aada619f98fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:09.275929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:09.276582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:09.276852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:09.277113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:09.277758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:09.278060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:09.279511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614f778-e92a-432d-a3be-b2ff6e6edd88 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:09.293053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 524/1064] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:09.718863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50fe77-be2a-42c1-9768-5d75e6d7a96c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:09.719385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50fe77-be2a-42c1-9768-5d75e6d7a96c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:09.719472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50fe77-be2a-42c1-9768-5d75e6d7a96c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:09.720800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 541/1065] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:09.726273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:09.726731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:09.726849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:09.745928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:09.747125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:09.818631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 525/1066] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:09 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:10.090554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50fe77-be2a-42c1-9768-5d75e6d7a96c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.203212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:10.208762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50fe77-be2a-42c1-9768-5d75e6d7a96c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.245262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.245890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.246225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.246478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.258842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:10.263689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:10.264715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:10.265691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 542/1067] 10.222.0.122 () {56 vars in 1125 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:10.272988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.370133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:10.382998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c324e7-ab9c-47ce-ab13-e6033d8720f2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.421000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.421603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.421883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.422155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.422875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:10.423298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.425659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.434514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 526/1068] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:10.441173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.566649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06c90-6359-4565-b891-cbf924f3dad3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.602364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.602993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.603267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.603535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.615310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.621755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:10.634784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:10.636068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:10.637020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:10.637020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:10.637020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:10.637020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 543/1069] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:10.642455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.759477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928beab-688a-45cf-b44c-f52780d5c83b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.798013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.798628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.799016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.799159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.799838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:10.800184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.801590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9befd-9ff6-4710-85ed-d7fbb9dc21ec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.815359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 527/1070] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:10.821135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.842823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:10.856380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26544-936e-4735-9284-1edd49a00726 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.856678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26544-936e-4735-9284-1edd49a00726 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.856946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26544-936e-4735-9284-1edd49a00726 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.858269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 528/1071] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:10.864146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.864466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.864742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.884391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:10.885619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:10.888599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:10.944669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f3d6-ba10-4317-8d6d-07920ad4951f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.968832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 529/1072] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:10 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:10.986818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.987454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.987733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.988010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.997750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.999452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:46:11.012059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:11.013314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:11.014576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 544/1073] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:11.019961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.127353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd101b20-2924-4cae-888d-373ebbcc7c95 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.162508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.163029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.163306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.163597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.164362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:11.164666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.166095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.176110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:11.185070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 530/1074] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:11.191617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.239918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.269385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:11.303257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc5a2-86d8-40c4-bc8b-90dce009352e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.347745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.349714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1cefe-27e1-4e67-a626-875e6a4a5843 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.350261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.350552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.350825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.364138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.365630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:11.381457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:11.382651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:11.383673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:11.383673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:11.383673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:11.383673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 545/1075] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:11.388449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.394276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.395264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.395681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.396024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.406851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:11.412440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:11.413656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:11.414537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 531/1076] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:11.419701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.484386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:11.523227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889167-6d76-4fb2-9df6-ef9777cd7a53 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.529675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301777c-3b53-40fe-9953-610a8ac7d675 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.557069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:11.566917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.567542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.567816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.568084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.568788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:11.569085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.570445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.571959 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.572630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.572910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.573181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.573817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:11.574114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.575462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.579829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 532/1077] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:11.585603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.589193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 546/1078] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:11.595534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.705250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc557-07a2-4e5c-b6ef-f842b44f815f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.713095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ed22-3f7c-458e-8d8e-09e43c115771 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.736205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:11.750459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.750663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.751136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.751260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.751418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.753881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] PATH_INFO: `/v3/users/c80970b23363483f99a8118c58e87159` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.753985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.753985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.754170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] RBAC: Authorizing `identity:get_user(user_id=c80970b23363483f99a8118c58e87159)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.754462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.756065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 533/1079] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/users/c80970b23363483f99a8118c58e87159 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:11.759325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.761142 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.761942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:46:11.773390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:11.774750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:11.775844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 547/1080] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:11.780450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.829930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:11.872482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2cef-bee2-4a90-9521-5a67c52a1144 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.889085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5610-6eea-45a1-8d0b-74a0c10dbdce None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:11.909286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.909963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.910251 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.910566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.911688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7d01a083194af4a28fcdedce738cb7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.913149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.914834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 534/1081] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:11.920918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.925710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:11.926373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:11.926678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:11.926946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:11.927647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:11.927954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:11.929442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:11.944072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 548/1082] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:11.950212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:11.984050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:12.030631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b421e-a200-41cb-a566-b3f04c85baa8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:12.062948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f13e-244c-47be-a218-52e9a3a09305 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:12.066041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:12.067882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2eb2ae-bc7f-44b7-a371-7c812173a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:12.068692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb2ae-bc7f-44b7-a371-7c812173a07a None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:12.068969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb2ae-bc7f-44b7-a371-7c812173a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:12.069241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb2ae-bc7f-44b7-a371-7c812173a07a None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7/users/c80970b23363483f99a8118c58e87159/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:12.071178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2eb2ae-bc7f-44b7-a371-7c812173a07a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e7d01a083194af4a28fcdedce738cb7, user_id=c80970b23363483f99a8118c58e87159, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:12.072643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2eb2ae-bc7f-44b7-a371-7c812173a07a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:12.098214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452d7a6-319b-449a-a4e7-5b3ca9ec0888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:12.098873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452d7a6-319b-449a-a4e7-5b3ca9ec0888 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:12.099146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452d7a6-319b-449a-a4e7-5b3ca9ec0888 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:12.099415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452d7a6-319b-449a-a4e7-5b3ca9ec0888 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7fd5dcca78134cbcaba474e435c7fd7e/roles/3430c7361a1c47a3846aa5771472cec6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:12.101686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452d7a6-319b-449a-a4e7-5b3ca9ec0888 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=7fd5dcca78134cbcaba474e435c7fd7e, role_id=3430c7361a1c47a3846aa5771472cec6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:12.103174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452d7a6-319b-449a-a4e7-5b3ca9ec0888 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:12.168404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 535/1083] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:46:11 2022] PUT /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7/users/c80970b23363483f99a8118c58e87159/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:12.197976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 549/1084] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:46:11 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/7fd5dcca78134cbcaba474e435c7fd7e/roles/3430c7361a1c47a3846aa5771472cec6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:46:14.133866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12736-7d5d-4099-ae4e-4a89562ca55b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.134432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12736-7d5d-4099-ae4e-4a89562ca55b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.134432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12736-7d5d-4099-ae4e-4a89562ca55b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.135735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 536/1085] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:14.141116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.142122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.142219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.160602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:14.161819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:14.177876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f22556-f936-454a-8ab9-304c7b67d287 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.178166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f22556-f936-454a-8ab9-304c7b67d287 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.178440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f22556-f936-454a-8ab9-304c7b67d287 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.179771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 537/1086] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:46:14.185211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.185498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.185776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.204850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:14.206069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:14.240472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 550/1087] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:14 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:14.279025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 538/1088] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:14 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:14.514596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.548727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.614118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:14.617822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:14.629363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc00b3-3369-43b2-a7ec-7e4870bab192 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.668643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5fb5-367f-4e15-a980-5b7842b64ebe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.671099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.671736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.672012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.672315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.682780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:14.687550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:14.689213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:14.690292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 551/1089] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:14.695193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.731342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.735810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.735810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.735810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.743785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:14.748998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:14.749952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:14.752129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 539/1090] 10.222.0.122 () {56 vars in 1125 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:14.758165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.803763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d6f37-1c6c-4da3-b4d2-ec8289c06183 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.841660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.842272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.842553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.842827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.843488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:14.843790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.845469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.854443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 552/1091] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:14.860712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.863926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5629da-fe7a-4585-a52c-905e53e58825 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.871106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:14.880436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:14.900094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.900836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.901118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.901393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.902060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:14.902445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.903822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.917839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 540/1092] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:14.918972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.970672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6fc2-2b4d-4c8c-9368-955f51181f61 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.007911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.008574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.008927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.009198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] PATH_INFO: `/v3/users/c80970b23363483f99a8118c58e87159` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.010378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] RBAC: Authorizing `identity:get_user(user_id=c80970b23363483f99a8118c58e87159)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.011826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.013446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 553/1093] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/users/c80970b23363483f99a8118c58e87159 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:15.020539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.027583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16996-308e-4383-9dc0-15bf8e5b8967 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.066019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.066573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.066853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.067121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.077643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.079131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:15.094139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:15.095439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:15.096378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:15.096378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:15.096378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:15.096378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 541/1094] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:15.101393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.115545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.126458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.132890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7632745-d1b4-446b-9030-ae1c16e5588c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.167627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.168320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.168535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.168809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.206862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f66c5-9e73-4dd2-bc92-6314314ecd06 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.240667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.242133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.247284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.248174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.248469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.248744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.249387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:15.249691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.251202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.264165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 542/1095] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:15.270864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.332063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.350226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 554/1096] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:46:15.356098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.359577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.379366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992305-246c-4ff1-9154-652e7613eae4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.416095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.417047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.417047 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.417338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.425087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.426539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:46:15.438863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:15.439975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:15.440992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 543/1097] 10.222.0.122 () {56 vars in 1098 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:15.446114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.465988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48523-be94-4add-8d52-00645c511260 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.514305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.514947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.515221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.515492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.517207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] RBAC: Authorizing `identity:get_project(project_id=9e7d01a083194af4a28fcdedce738cb7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.522556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.524719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 555/1098] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:15.530252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.552693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe91601-10ca-4fa5-9aa8-88edbb178d23 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.585791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.588053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.588691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.589002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.589278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.590003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:15.590310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.591738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.602585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.611717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 544/1099] 10.222.0.122 () {56 vars in 1138 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:15.618057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:15.636034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c1e02-ef60-48ac-99b7-6fecdb7abc6c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.671021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.671780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.672052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.672354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.673903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=9e7d01a083194af4a28fcdedce738cb7, user.id=c80970b23363483f99a8118c58e87159) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:15.674308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.675816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.682327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 556/1100] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/role_assignments?user.id=c80970b23363483f99a8118c58e87159&scope.project.id=9e7d01a083194af4a28fcdedce738cb7&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:15.731423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9cda2-5c6d-4162-bc0f-e49646eac4dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:15.773689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:15.774317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:15.774592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:15.774887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:15.862557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:15.866709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:15.868231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:15.976079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 545/1101] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:46:15.982334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:16.093522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2e804-c2c0-4138-aaaa-b274c484ffdd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:16.113743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:16.132364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:16.132993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:16.133314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:16.133584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:16.144123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:16.145650 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:16.160728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:16.161895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:46:16.162813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:16.162813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:46:16.162813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:16.162813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 557/1102] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:46:16.167654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:16.269807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:16.274310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1778d-138b-49e0-bc4f-35ab0906a680 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:16.315328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:16.315946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:16.316262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:16.316536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:16.317184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:16.317486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:16.318929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:16.332170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 546/1103] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:46:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:16.338028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:16.456352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6137-5cfb-4135-9b8f-7b3e5f343015 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:16.495020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:16.495725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:16.496006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:16.496313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:16.504995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:16.506473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:46:16.520297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:16.521316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:16.522220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 558/1104] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:16.527750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:16.648053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c42533-4ea5-4348-930c-523a58102788 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:16.698765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:16.699433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:16.699735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:16.700009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:16.700724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:16.701027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:16.702562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae58270-8a88-4215-adae-f09580e15d5f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:16.717593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 547/1105] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:16.724426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:16.758420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:16.851434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e941b-d73d-4816-ad01-d1e696b7c6c5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:16.888566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:16.889173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:16.889448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:16.889799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:16.890435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] RBAC: Adding query filter params (role.id=3430c7361a1c47a3846aa5771472cec6, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=7fd5dcca78134cbcaba474e435c7fd7e) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:16.890736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:16.892794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde2357-76af-45fc-9f21-8fc401e91daa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:16.899305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 559/1106] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:16 2022] GET /identity/v3/role_assignments?user.id=7fd5dcca78134cbcaba474e435c7fd7e&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=3430c7361a1c47a3846aa5771472cec6 => generated 610 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:17.698535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9c72-df2a-46bf-8083-fe79b9c32373 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:17.699084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9c72-df2a-46bf-8083-fe79b9c32373 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:17.699084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9c72-df2a-46bf-8083-fe79b9c32373 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:17.702979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 548/1107] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:17.710442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:17.710900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:17.711360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:17.731640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:17.732880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:17.813900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 560/1108] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:17 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:18.099054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9c72-df2a-46bf-8083-fe79b9c32373 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:18.118841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:18.206597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9c72-df2a-46bf-8083-fe79b9c32373 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:18.243518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ad85e-5eaf-429d-9a92-12671f927470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:18.244182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ad85e-5eaf-429d-9a92-12671f927470 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:18.244460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ad85e-5eaf-429d-9a92-12671f927470 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:18.244733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ad85e-5eaf-429d-9a92-12671f927470 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:18.245909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ad85e-5eaf-429d-9a92-12671f927470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:18.247337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ad85e-5eaf-429d-9a92-12671f927470 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:18.249174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 549/1109] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:18 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:18.255268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:18.279340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:18.356315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dedc9c-e472-4456-9431-6bd3158d4161 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:18.390274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda7b0-4e6f-49fc-967a-ea3f1fad3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:18.390868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda7b0-4e6f-49fc-967a-ea3f1fad3d84 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:18.391268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda7b0-4e6f-49fc-967a-ea3f1fad3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:18.391548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda7b0-4e6f-49fc-967a-ea3f1fad3d84 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:18.392192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cda7b0-4e6f-49fc-967a-ea3f1fad3d84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:18.393621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cda7b0-4e6f-49fc-967a-ea3f1fad3d84 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:18.482177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 561/1110] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:46:18 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:20.596753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4f9f-30f2-432c-a272-a6eed7f08d0b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:20.597320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4f9f-30f2-432c-a272-a6eed7f08d0b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:20.597320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf4f9f-30f2-432c-a272-a6eed7f08d0b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:20.598646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 550/1111] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:20.605310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:20.605894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:20.605894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:20.624885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:20.626810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:20.702267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 562/1112] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:20 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:20.987892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4f9f-30f2-432c-a272-a6eed7f08d0b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:21.076795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:21.100030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf4f9f-30f2-432c-a272-a6eed7f08d0b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:21.136971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:21.137639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:21.137920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:21.138192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] PATH_INFO: `/v3/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:21.139625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] RBAC: Authorizing `identity:get_role(role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:21.141571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:21.143027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 551/1113] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:20 2022] GET /identity/v3/roles/6597e480361e45bbb37dc41cff9e4582 => generated 224 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:21.148987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:21.159618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:21.253895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219f05-aa87-4e75-bc58-6f8575866808 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:21.286986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:21.287607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:21.287885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:21.288185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] PATH_INFO: `/v3/users/525263e627384a0eb52eb881a0c490ec` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:21.301160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] RBAC: Authorizing `identity:get_user(user_id=525263e627384a0eb52eb881a0c490ec)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:21.302707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:21.304355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 563/1114] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:21 2022] GET /identity/v3/users/525263e627384a0eb52eb881a0c490ec => generated 287 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:21.310281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:21.408571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cb31-d96c-4c15-8f9e-c47ba0a76de2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:21.443010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:21.443613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:21.443890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:21.444244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:21.467088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:21.510130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:21.511509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:21.607862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 552/1115] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:21 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:21.614681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:21.680025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:21.714486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a7c28-b5cb-41ed-aaf9-66a8a0ee191b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:21.749432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22737e73-5ba4-4a8d-953b-474793ebad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:21.750080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737e73-5ba4-4a8d-953b-474793ebad73 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:21.750452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737e73-5ba4-4a8d-953b-474793ebad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:21.750731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22737e73-5ba4-4a8d-953b-474793ebad73 None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:21.751826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22737e73-5ba4-4a8d-953b-474793ebad73 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7d01a083194af4a28fcdedce738cb7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:21.753287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22737e73-5ba4-4a8d-953b-474793ebad73 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:21.754914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 564/1116] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:21 2022] GET /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7 => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:21.761141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:21.815654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:21.860588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81bd4a-8cfe-47fa-b153-359f4dc418bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:21.894805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:21.895408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:21.895689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:21.895960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:21.896723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] RBAC: Adding query filter params (role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=9e7d01a083194af4a28fcdedce738cb7, user.id=525263e627384a0eb52eb881a0c490ec) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:21.897159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:21.898573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101d80-c4a5-413b-9934-2b6c8697eadf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:21.903803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 553/1117] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:21 2022] GET /identity/v3/role_assignments?user.id=525263e627384a0eb52eb881a0c490ec&scope.project.id=9e7d01a083194af4a28fcdedce738cb7&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:23.808728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17f606-505c-4943-9067-7c5db8ef903f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:23.809284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17f606-505c-4943-9067-7c5db8ef903f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:23.809284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17f606-505c-4943-9067-7c5db8ef903f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:23.810649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 565/1118] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:23.818435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:23.818958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:23.819065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:23.838438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:23.839645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:23.914478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 554/1119] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:23 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:24.187076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17f606-505c-4943-9067-7c5db8ef903f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:24.299109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17f606-505c-4943-9067-7c5db8ef903f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:24.340726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:24.341383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:24.341663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:24.341935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] PATH_INFO: `/v3/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:24.343376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] RBAC: Authorizing `identity:get_role(role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:24.344949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:24.346312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 566/1120] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:24 2022] GET /identity/v3/roles/6597e480361e45bbb37dc41cff9e4582 => generated 224 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:24.352434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:24.406802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:24.459977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a93e5-dab0-45fc-825b-19d96667901d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:24.496471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:24.497368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:24.497638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:24.497906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] PATH_INFO: `/v3/users/525263e627384a0eb52eb881a0c490ec` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:24.499059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] RBAC: Authorizing `identity:get_user(user_id=525263e627384a0eb52eb881a0c490ec)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:24.501158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:24.502770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 555/1121] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:24 2022] GET /identity/v3/users/525263e627384a0eb52eb881a0c490ec => generated 287 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:24.510541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:24.514611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:24.655072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ef152-02fd-4652-96e6-a5a3f97a2b35 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:24.693063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed41a3a-1393-48f0-a9b3-1fd3059ab018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:24.693694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41a3a-1393-48f0-a9b3-1fd3059ab018 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:24.693973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41a3a-1393-48f0-a9b3-1fd3059ab018 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:24.694249 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41a3a-1393-48f0-a9b3-1fd3059ab018 None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:24.695378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed41a3a-1393-48f0-a9b3-1fd3059ab018 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7d01a083194af4a28fcdedce738cb7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:24.696859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed41a3a-1393-48f0-a9b3-1fd3059ab018 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:24.698526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 567/1122] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:24 2022] GET /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:24.705348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:24.813371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2e6b8-a909-4960-b53b-2139517e3242 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:24.833093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:24.851339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f068ceb-4e7d-4f02-b7a0-99ff6f39ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:24.852009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f068ceb-4e7d-4f02-b7a0-99ff6f39ad3c None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:24.852327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f068ceb-4e7d-4f02-b7a0-99ff6f39ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:24.853861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f068ceb-4e7d-4f02-b7a0-99ff6f39ad3c None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7/users/525263e627384a0eb52eb881a0c490ec/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:24.854905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f068ceb-4e7d-4f02-b7a0-99ff6f39ad3c None admin] RBAC: Authorizing `identity:create_grant(project_id=9e7d01a083194af4a28fcdedce738cb7, user_id=525263e627384a0eb52eb881a0c490ec, role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:24.856407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f068ceb-4e7d-4f02-b7a0-99ff6f39ad3c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:24.950273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 556/1123] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:46:24 2022] PUT /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7/users/525263e627384a0eb52eb881a0c490ec/roles/6597e480361e45bbb37dc41cff9e4582 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:26.914678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc899150-e9f5-41ce-8c16-9aea9bcce871 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:26.915284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc899150-e9f5-41ce-8c16-9aea9bcce871 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:26.915284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc899150-e9f5-41ce-8c16-9aea9bcce871 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:26.916620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 568/1124] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:26.922643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:26.923167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:26.923332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:26.942985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:26.944209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:27.014775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 557/1125] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:26 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:27.287566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc899150-e9f5-41ce-8c16-9aea9bcce871 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:27.378357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:27.414401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc899150-e9f5-41ce-8c16-9aea9bcce871 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:27.468841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:27.469566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:27.470032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:27.470341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] PATH_INFO: `/v3/roles/6597e480361e45bbb37dc41cff9e4582` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:27.471982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] RBAC: Authorizing `identity:get_role(role_id=6597e480361e45bbb37dc41cff9e4582)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:27.473457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:27.474904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 569/1126] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:27 2022] GET /identity/v3/roles/6597e480361e45bbb37dc41cff9e4582 => generated 224 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:27.481110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:27.585434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8536-d1ee-4cf2-956a-a76c8b5dc167 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:27.593008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:27.621336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:27.622221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:27.622502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:27.622776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] PATH_INFO: `/v3/users/525263e627384a0eb52eb881a0c490ec` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:27.623899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] RBAC: Authorizing `identity:get_user(user_id=525263e627384a0eb52eb881a0c490ec)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:27.625532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:27.627221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 558/1127] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:27 2022] GET /identity/v3/users/525263e627384a0eb52eb881a0c490ec => generated 287 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:27.633331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:27.740300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45acdc9-c510-4c4c-80d1-f34d09130528 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:27.778983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:27.779607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:27.779888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:27.780189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:27.790224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:27.850405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:27.851778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:27.957603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 570/1128] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:27 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:27.963875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:28.068734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930de03-e199-45d8-b522-5b6a18112479 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:28.103288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269ee14-9a35-432f-8d31-89a3bc505c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:28.103824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269ee14-9a35-432f-8d31-89a3bc505c91 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:28.104104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269ee14-9a35-432f-8d31-89a3bc505c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:28.104405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269ee14-9a35-432f-8d31-89a3bc505c91 None admin] PATH_INFO: `/v3/projects/9e7d01a083194af4a28fcdedce738cb7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:28.105535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269ee14-9a35-432f-8d31-89a3bc505c91 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7d01a083194af4a28fcdedce738cb7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:28.106967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269ee14-9a35-432f-8d31-89a3bc505c91 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:28.110727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 559/1129] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:27 2022] GET /identity/v3/projects/9e7d01a083194af4a28fcdedce738cb7 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:28.115956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:28.158767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:28.227707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc486-a09b-41dc-b2c0-22f9797cc260 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:28.265129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:28.266547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:28.266836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:28.267105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:28.267826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] RBAC: Adding query filter params (role.id=6597e480361e45bbb37dc41cff9e4582, scope.project.id=9e7d01a083194af4a28fcdedce738cb7, user.id=525263e627384a0eb52eb881a0c490ec) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:28.268129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:28.269584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bcaae-e347-45cd-9307-543b9b17e5a7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:28.280024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 571/1130] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:28 2022] GET /identity/v3/role_assignments?user.id=525263e627384a0eb52eb881a0c490ec&scope.project.id=9e7d01a083194af4a28fcdedce738cb7&role.id=6597e480361e45bbb37dc41cff9e4582 => generated 610 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:30.250991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b717f-5676-4822-9ff9-e1aef6ed3137 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:30.251580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b717f-5676-4822-9ff9-e1aef6ed3137 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:30.251580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b717f-5676-4822-9ff9-e1aef6ed3137 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:30.252922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 560/1131] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:30.258923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:30.259466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:30.259466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:30.278524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:30.279791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:30.354104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 572/1132] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:30 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:30.631518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b717f-5676-4822-9ff9-e1aef6ed3137 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:30.676616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:30.733834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b717f-5676-4822-9ff9-e1aef6ed3137 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:30.767259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2588-6990-40a8-9028-e523b96bd1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:30.768417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2588-6990-40a8-9028-e523b96bd1be None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:30.768417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2588-6990-40a8-9028-e523b96bd1be None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:30.768848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2588-6990-40a8-9028-e523b96bd1be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:30.769847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2588-6990-40a8-9028-e523b96bd1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:30.771263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2588-6990-40a8-9028-e523b96bd1be None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:30.772834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 561/1133] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:30.778662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:30.809864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:30.879896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844c88c-82df-478f-abdb-ae82db38e728 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:30.915344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f73027-c70c-4382-8670-11e12337cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:30.915861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f73027-c70c-4382-8670-11e12337cd43 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:30.916137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f73027-c70c-4382-8670-11e12337cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:30.916434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f73027-c70c-4382-8670-11e12337cd43 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:30.917069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f73027-c70c-4382-8670-11e12337cd43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:30.918521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f73027-c70c-4382-8670-11e12337cd43 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:31.077092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 573/1134] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:46:30 2022] POST /identity/v3/projects => generated 312 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:33.106916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4714-93b8-4ebb-a262-ea684ac39f71 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:33.107445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4714-93b8-4ebb-a262-ea684ac39f71 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:33.107445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4714-93b8-4ebb-a262-ea684ac39f71 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:33.108798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 562/1135] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:33.114318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:33.114779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:33.114879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:33.133390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:33.134593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:33.206776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 574/1136] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:33 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:33.484768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4714-93b8-4ebb-a262-ea684ac39f71 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:33.591949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4714-93b8-4ebb-a262-ea684ac39f71 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:33.604133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:33.629761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee587448-e9d8-406e-accb-bf4344c7ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:33.630387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587448-e9d8-406e-accb-bf4344c7ba2e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:33.630663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587448-e9d8-406e-accb-bf4344c7ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:33.630928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587448-e9d8-406e-accb-bf4344c7ba2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:33.632031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee587448-e9d8-406e-accb-bf4344c7ba2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:33.633628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee587448-e9d8-406e-accb-bf4344c7ba2e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:33.635229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 563/1137] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:46:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:33.641984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:33.661197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:33.750004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711977d-ab64-45f2-a94e-83a2bfe1c692 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:33.784563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3969fd-3852-4d1c-9999-b695ed68f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:33.785178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3969fd-3852-4d1c-9999-b695ed68f1a2 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:33.785456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3969fd-3852-4d1c-9999-b695ed68f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:33.785727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3969fd-3852-4d1c-9999-b695ed68f1a2 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:33.786370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3969fd-3852-4d1c-9999-b695ed68f1a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:33.787814 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3969fd-3852-4d1c-9999-b695ed68f1a2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:33.910686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 575/1138] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:46:33 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:35.917038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dcda9-816f-4dc5-a63b-1e6888e8fa54 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:35.917611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dcda9-816f-4dc5-a63b-1e6888e8fa54 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:35.917611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dcda9-816f-4dc5-a63b-1e6888e8fa54 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:35.918901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 564/1139] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:35.925217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:35.925642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:35.925763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:35.944945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:35.946147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:36.010057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:36.014870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 576/1140] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:35 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:36.287866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dcda9-816f-4dc5-a63b-1e6888e8fa54 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:36.389284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dcda9-816f-4dc5-a63b-1e6888e8fa54 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:36.424392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:36.424998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:36.425275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:36.425545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:36.435208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:36.440101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:36.441309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:36.442408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 565/1141] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:36.447282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:36.547708 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868abbe-7430-4c38-bcc7-ccb87b39a25f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:36.581049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:36.581649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:36.581922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:36.582188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:36.582838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:36.583134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:36.584522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:36.592394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 577/1142] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:36.598868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:36.640771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:36.699222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0182-c397-456a-a29d-0aba613b6def None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:36.733916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:36.734535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:36.734876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:36.735152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] PATH_INFO: `/v3/users/509637fb0c97430fab7232b58ab6e58c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:36.748308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] RBAC: Authorizing `identity:get_user(user_id=509637fb0c97430fab7232b58ab6e58c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:36.750415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:36.752054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 566/1143] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:36 2022] GET /identity/v3/users/509637fb0c97430fab7232b58ab6e58c => generated 287 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:36.758082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:36.833256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:36.873014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aad27-50c5-4a62-b006-cc1a89485db0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:36.911674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:36.912308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:36.912592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:36.912862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:36.980549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:36.982115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:37.042057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:37.081638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 578/1144] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:36 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:37.087757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:37.179729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:37.185403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568932-9250-4a0e-9a8c-a3129b1dc11d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:37.219911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2499f5-6fac-4fa3-bfb8-6d584844725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:37.220549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2499f5-6fac-4fa3-bfb8-6d584844725f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:37.220829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2499f5-6fac-4fa3-bfb8-6d584844725f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:37.221100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2499f5-6fac-4fa3-bfb8-6d584844725f None admin] PATH_INFO: `/v3/projects/7e8e3c2589424025b69541bb68640473` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:37.222263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2499f5-6fac-4fa3-bfb8-6d584844725f None admin] RBAC: Authorizing `identity:get_project(project_id=7e8e3c2589424025b69541bb68640473)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:37.223690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2499f5-6fac-4fa3-bfb8-6d584844725f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:37.225331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 567/1145] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:37 2022] GET /identity/v3/projects/7e8e3c2589424025b69541bb68640473 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:37.231510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:37.332620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900be9-4867-48cd-a7ad-02af1dec6081 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:37.366469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:37.366993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:37.367269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:37.367538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:37.368279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=7e8e3c2589424025b69541bb68640473, user.id=509637fb0c97430fab7232b58ab6e58c) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:37.368582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:37.370001 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14ecb3-d5ba-4f13-9a90-ab739137995d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:37.378688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 579/1146] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:37 2022] GET /identity/v3/role_assignments?user.id=509637fb0c97430fab7232b58ab6e58c&scope.project.id=7e8e3c2589424025b69541bb68640473&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:39.298839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ba7e9-7249-4abd-9259-f6903adf0810 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:39.299413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ba7e9-7249-4abd-9259-f6903adf0810 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:39.299413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ba7e9-7249-4abd-9259-f6903adf0810 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:39.300777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 568/1147] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:39.306039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:39.306465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:39.306559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:39.325618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:39.326855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:39.352548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:39.400889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 580/1148] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:39 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:39.683075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ba7e9-7249-4abd-9259-f6903adf0810 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:39.788568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ba7e9-7249-4abd-9259-f6903adf0810 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:39.821400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:39.822011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:39.822286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:39.822552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:39.833472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:39.838098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:39.839207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:39.840085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 569/1149] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:39.846166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:39.945565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea9f7b-8309-4016-abe2-69fd0db2fee4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:39.980263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:39.980864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:39.981141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:39.981415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:39.982070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:39.982370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:39.983773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:39.991791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 581/1150] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:39.998350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:40.025028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:40.098501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83a8c-1052-4ef0-9f62-1d64fd14059d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:40.132289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:40.132905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:40.133181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:40.133449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] PATH_INFO: `/v3/users/509637fb0c97430fab7232b58ab6e58c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:40.134546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] RBAC: Authorizing `identity:get_user(user_id=509637fb0c97430fab7232b58ab6e58c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:40.135947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:40.137545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 570/1151] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:39 2022] GET /identity/v3/users/509637fb0c97430fab7232b58ab6e58c => generated 287 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:40.144524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:40.164771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:40.243994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c4507-c671-4945-9f97-3998eed801eb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:40.278198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429cba3-2c48-4680-bb59-c134b194a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:40.278815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429cba3-2c48-4680-bb59-c134b194a0ca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:40.279088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429cba3-2c48-4680-bb59-c134b194a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:40.279354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429cba3-2c48-4680-bb59-c134b194a0ca None admin] PATH_INFO: `/v3/projects/7e8e3c2589424025b69541bb68640473` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:40.280518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429cba3-2c48-4680-bb59-c134b194a0ca None admin] RBAC: Authorizing `identity:get_project(project_id=7e8e3c2589424025b69541bb68640473)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:40.281931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429cba3-2c48-4680-bb59-c134b194a0ca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:40.283542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 582/1152] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:40 2022] GET /identity/v3/projects/7e8e3c2589424025b69541bb68640473 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:40.289680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:40.381484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:40.390501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b44a-6339-45ac-88b6-666f56ff3df5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:40.425264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499f28e-7fe7-4096-b052-b27cffdceaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:40.425908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499f28e-7fe7-4096-b052-b27cffdceaeb None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:40.426184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499f28e-7fe7-4096-b052-b27cffdceaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:40.426452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499f28e-7fe7-4096-b052-b27cffdceaeb None admin] PATH_INFO: `/v3/projects/7e8e3c2589424025b69541bb68640473/users/509637fb0c97430fab7232b58ab6e58c/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:40.428356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499f28e-7fe7-4096-b052-b27cffdceaeb None admin] RBAC: Authorizing `identity:create_grant(project_id=7e8e3c2589424025b69541bb68640473, user_id=509637fb0c97430fab7232b58ab6e58c, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:40.429774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499f28e-7fe7-4096-b052-b27cffdceaeb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:40.515299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 571/1153] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:46:40 2022] PUT /identity/v3/projects/7e8e3c2589424025b69541bb68640473/users/509637fb0c97430fab7232b58ab6e58c/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:42.414360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1787-8920-428f-b3eb-7aef6993a590 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:42.414900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1787-8920-428f-b3eb-7aef6993a590 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:42.414900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1787-8920-428f-b3eb-7aef6993a590 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:42.416441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 583/1154] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:42.421786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:42.422196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:42.422323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:42.440948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:42.442150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:42.508280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 572/1155] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:42 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:42.789724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1787-8920-428f-b3eb-7aef6993a590 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:42.878228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:42.894105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1787-8920-428f-b3eb-7aef6993a590 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:42.927901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:42.928550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:42.928826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:42.929095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:42.940576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:42.945224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:42.946317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:42.947200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 584/1156] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:42.952523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:43.033290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:43.050937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d775a-1b4d-4845-ba1c-6411b3650079 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:43.085590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:43.086197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:43.086479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:43.086746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:43.091269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:43.091269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:43.091269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:43.099230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 573/1157] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:43.105321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:43.204664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9451-3cbd-4d58-a466-fdbc656ada7e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:43.238727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:43.239350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:43.239630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:43.239904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] PATH_INFO: `/v3/users/509637fb0c97430fab7232b58ab6e58c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:43.241158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] RBAC: Authorizing `identity:get_user(user_id=509637fb0c97430fab7232b58ab6e58c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:43.242595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:43.244381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 585/1158] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:43 2022] GET /identity/v3/users/509637fb0c97430fab7232b58ab6e58c => generated 287 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:43.250476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:43.348912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a018-b419-43be-97c4-b2114d224354 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:43.383271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:43.383863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:43.384137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:43.384437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:43.398940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:43.450072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:43.452010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:43.547523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 574/1159] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:43 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:43.553616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:43.568966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:43.656253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86692b65-559d-4d23-81cc-2b63610791aa None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:43.690657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5b7f0-e4a3-4bd0-8265-59526bac4cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:43.691274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5b7f0-e4a3-4bd0-8265-59526bac4cfd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:43.691552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5b7f0-e4a3-4bd0-8265-59526bac4cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:43.691822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5b7f0-e4a3-4bd0-8265-59526bac4cfd None admin] PATH_INFO: `/v3/projects/7e8e3c2589424025b69541bb68640473` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:43.692944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5b7f0-e4a3-4bd0-8265-59526bac4cfd None admin] RBAC: Authorizing `identity:get_project(project_id=7e8e3c2589424025b69541bb68640473)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:43.694364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5b7f0-e4a3-4bd0-8265-59526bac4cfd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:43.695987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 586/1160] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:43 2022] GET /identity/v3/projects/7e8e3c2589424025b69541bb68640473 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:43.702981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:43.747585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:43.800751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ff6b-aaac-4fb6-890b-05ba477db008 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:43.834209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:43.834800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:43.835078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:43.835347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:43.836058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=7e8e3c2589424025b69541bb68640473, user.id=509637fb0c97430fab7232b58ab6e58c) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:43.836388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:43.837812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea544e33-121e-4da1-a50f-0d4a19e41869 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:43.843422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 575/1161] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:43 2022] GET /identity/v3/role_assignments?user.id=509637fb0c97430fab7232b58ab6e58c&scope.project.id=7e8e3c2589424025b69541bb68640473&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:45.795952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123b731-6bba-48df-a1d6-ab49cc00ae13 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:45.796539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123b731-6bba-48df-a1d6-ab49cc00ae13 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:45.796539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123b731-6bba-48df-a1d6-ab49cc00ae13 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:45.797851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 587/1162] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:45.803327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:45.803868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:45.803868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:45.824791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:45.826029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:45.895595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 576/1163] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:45 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:46.165992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123b731-6bba-48df-a1d6-ab49cc00ae13 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:46.249448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:46.268178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123b731-6bba-48df-a1d6-ab49cc00ae13 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:46.303682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:46.304324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:46.304604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:46.304874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:46.373808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:46.375320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:46.456472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:46.475235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 588/1164] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:46 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:46.481346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:46.522293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:46.582169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd69d1-f1c0-423e-816c-1de5ff517cdf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:46.616555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:46.617180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:46.617461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:46.617744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:46.625495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:46.626937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d248b0a1-ff7e-4ade-bb2e-62066fdeb93e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:46.638028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:46.640672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:46:46.641924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 577/1165] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:46:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:46.647120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:46.751176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6242-8f2b-49c2-96fe-080cc5a8d6ec None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:46.785527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:46.786132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:46.786404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:46.786672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:46.787309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:46.787604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:46.788998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df404a-d0c8-4d00-afee-708151af561e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:46.796358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 589/1166] 10.222.0.122 () {56 vars in 1120 bytes} [Fri Aug 26 00:46:46 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:48.738176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434b74-7b49-4826-8fde-c0ecff612ba3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:48.738707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434b74-7b49-4826-8fde-c0ecff612ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:48.738707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434b74-7b49-4826-8fde-c0ecff612ba3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:48.740036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 578/1167] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:48.745773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fc7b-a312-46e3-a747-e5c88a26b3b1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:48.746207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fc7b-a312-46e3-a747-e5c88a26b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:48.746298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fc7b-a312-46e3-a747-e5c88a26b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:48.767016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e278fc7b-a312-46e3-a747-e5c88a26b3b1 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:48.768260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e278fc7b-a312-46e3-a747-e5c88a26b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:48.813651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:48.838957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 590/1168] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:48 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:49.122231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434b74-7b49-4826-8fde-c0ecff612ba3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:49.219942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:49.224602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434b74-7b49-4826-8fde-c0ecff612ba3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:49.258673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa9c77-98c0-436a-9bcc-9d59d9a02dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:49.259269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9c77-98c0-436a-9bcc-9d59d9a02dad None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:49.259545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9c77-98c0-436a-9bcc-9d59d9a02dad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:49.259812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9c77-98c0-436a-9bcc-9d59d9a02dad None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:49.260496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa9c77-98c0-436a-9bcc-9d59d9a02dad None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:49.261843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa9c77-98c0-436a-9bcc-9d59d9a02dad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:49.343572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 579/1169] 10.222.0.122 () {60 vars in 1143 bytes} [Fri Aug 26 00:46:49 2022] POST /identity/v3/domains => generated 268 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:51.326940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d976b-b650-4a8e-998b-28e867996c62 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:51.327526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d976b-b650-4a8e-998b-28e867996c62 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:51.327526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d976b-b650-4a8e-998b-28e867996c62 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:51.328894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 591/1170] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:51.334565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:51.335025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:51.335143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:51.355076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:51.356322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:51.425773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 580/1171] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:51 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:51.703656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d976b-b650-4a8e-998b-28e867996c62 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:51.814027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d976b-b650-4a8e-998b-28e867996c62 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:51.848530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938dea4-aeb5-4fe3-b405-692a23d487cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:51.849165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938dea4-aeb5-4fe3-b405-692a23d487cb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:51.849437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938dea4-aeb5-4fe3-b405-692a23d487cb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:51.849714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938dea4-aeb5-4fe3-b405-692a23d487cb None admin] PATH_INFO: `/v3/domains/1f281d640f4b411792c59a378183fd67` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:51.861183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938dea4-aeb5-4fe3-b405-692a23d487cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=1f281d640f4b411792c59a378183fd67)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:51.862641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938dea4-aeb5-4fe3-b405-692a23d487cb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:51.864331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 592/1172] 10.222.0.122 () {56 vars in 1188 bytes} [Fri Aug 26 00:46:51 2022] GET /identity/v3/domains/1f281d640f4b411792c59a378183fd67 => generated 268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:51.870748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:51.964617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:51.977538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729b63-2b13-4aa8-8954-64f7bc9bf3c8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:52.012086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d455bff-f969-4f79-8d88-61065ff283d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:52.012720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455bff-f969-4f79-8d88-61065ff283d5 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:52.012998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455bff-f969-4f79-8d88-61065ff283d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:52.013788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d455bff-f969-4f79-8d88-61065ff283d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:52.014488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d455bff-f969-4f79-8d88-61065ff283d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:52.015882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d455bff-f969-4f79-8d88-61065ff283d5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:52.110323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 581/1173] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:46:51 2022] POST /identity/v3/projects => generated 362 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:46:54.114939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088dd30-06b1-41d4-88f0-7b15635441c5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:54.115537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088dd30-06b1-41d4-88f0-7b15635441c5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:54.115537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088dd30-06b1-41d4-88f0-7b15635441c5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:54.116853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 593/1174] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:54.123858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:54.124374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:54.124473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:54.145446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:54.146646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:54.213729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 582/1175] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:54 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:46:54.493536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088dd30-06b1-41d4-88f0-7b15635441c5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:54.533236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:54.600053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088dd30-06b1-41d4-88f0-7b15635441c5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:54.635109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66ef6-e9c8-4277-b865-838b309c510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:54.635732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66ef6-e9c8-4277-b865-838b309c510a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:54.636009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66ef6-e9c8-4277-b865-838b309c510a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:54.636311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66ef6-e9c8-4277-b865-838b309c510a None admin] PATH_INFO: `/v3/domains/1f281d640f4b411792c59a378183fd67` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:54.637448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66ef6-e9c8-4277-b865-838b309c510a None admin] RBAC: Authorizing `identity:get_domain(domain_id=1f281d640f4b411792c59a378183fd67)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:54.638906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66ef6-e9c8-4277-b865-838b309c510a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:54.640597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 594/1176] 10.222.0.122 () {56 vars in 1188 bytes} [Fri Aug 26 00:46:54 2022] GET /identity/v3/domains/1f281d640f4b411792c59a378183fd67 => generated 268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:54.646576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:54.715691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:54.745965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf5568-4c5c-4456-8c85-5e084fc5f2f5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:54.780615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6a7b2-350a-48c7-9c94-08c926d8141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:54.781218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a7b2-350a-48c7-9c94-08c926d8141e None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:54.781497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a7b2-350a-48c7-9c94-08c926d8141e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:54.781767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6a7b2-350a-48c7-9c94-08c926d8141e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:54.782412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a7b2-350a-48c7-9c94-08c926d8141e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:54.783864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6a7b2-350a-48c7-9c94-08c926d8141e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:54.885263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 583/1177] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:46:54 2022] POST /identity/v3/users => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:56.851660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaa1c-a5df-4fa8-a5d4-dcb477b2178b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:56.852248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaa1c-a5df-4fa8-a5d4-dcb477b2178b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:56.852248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaa1c-a5df-4fa8-a5d4-dcb477b2178b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:56.853615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 595/1178] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:46:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:46:56.859937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:56.860491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:56.860491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:56.884550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:56.885743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:56.953443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 584/1179] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:46:56 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:46:57.233000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaa1c-a5df-4fa8-a5d4-dcb477b2178b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:57.344337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaa1c-a5df-4fa8-a5d4-dcb477b2178b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:57.351548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:57.378471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:57.379080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:57.379350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:57.379614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:57.391131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:46:57.395875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:46:57.397122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:46:57.398419 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 596/1180] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:46:57.405853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:57.461046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:57.504771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e51fb8-2667-452f-8183-8c4d7a2a255f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:57.539287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:57.539888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:57.540181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:57.540461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:57.541111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:57.541410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:57.542768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:57.550606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 585/1181] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:46:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:57.556556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:57.658175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f70886-f3a4-4fe4-97ad-75c30630f0d6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:57.784360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:57.784910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:57.785216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:57.785489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] PATH_INFO: `/v3/users/86b2293a7dac435395ac280afdc21bb6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:57.800499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] RBAC: Authorizing `identity:get_user(user_id=86b2293a7dac435395ac280afdc21bb6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:57.801948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:57.803617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 597/1182] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:46:57 2022] GET /identity/v3/users/86b2293a7dac435395ac280afdc21bb6 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:57.810287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:57.910186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b051033-acbf-4a43-ad08-11ff1702ed09 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:57.926813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:57.942754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:57.943349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:57.943625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:57.943892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:58.009185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:58.010618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:58.107519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 586/1183] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:46:57 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:46:58.113657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:58.143063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:58.221044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2c72-7677-48a2-820f-30e9b771fc98 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:58.255000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346f489-cb74-432d-abdd-cb24221709e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:58.255615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346f489-cb74-432d-abdd-cb24221709e0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:58.255890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346f489-cb74-432d-abdd-cb24221709e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:58.256186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346f489-cb74-432d-abdd-cb24221709e0 None admin] PATH_INFO: `/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:58.257278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346f489-cb74-432d-abdd-cb24221709e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4b8ec7c6cce8467a84c3a3160c4dcdc2)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:58.258701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346f489-cb74-432d-abdd-cb24221709e0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:58.260400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 598/1184] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:46:58 2022] GET /identity/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:58.268006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:58.287003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:58.367160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbadf-7629-4055-95ba-90c72ef598bb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:58.400827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:58.401443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:58.401702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:58.401972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:58.402691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=4b8ec7c6cce8467a84c3a3160c4dcdc2, user.id=86b2293a7dac435395ac280afdc21bb6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:58.403149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:58.404700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee13a36-5f55-418f-822d-d9fabf857ab6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:58.409914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 587/1185] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:46:58 2022] GET /identity/v3/role_assignments?user.id=86b2293a7dac435395ac280afdc21bb6&scope.project.id=4b8ec7c6cce8467a84c3a3160c4dcdc2&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:00.298135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdf970-cf38-4a91-9fb6-223c0482166f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:00.298758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdf970-cf38-4a91-9fb6-223c0482166f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:00.298758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdf970-cf38-4a91-9fb6-223c0482166f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:00.300025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 599/1186] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:47:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:47:00.305606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:00.306051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:00.306160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:00.324689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:00.326024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:00.397190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 588/1187] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:47:00 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:47:00.671888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdf970-cf38-4a91-9fb6-223c0482166f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:00.775642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:00.786958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdf970-cf38-4a91-9fb6-223c0482166f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:00.822684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:00.823307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:00.823585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:00.823854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:00.834353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:47:00.839048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:47:00.840208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:47:00.841465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 600/1188] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:47:00.846400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:00.861147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:00.948473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3470c50-dfdd-4615-8f8e-d5b7cf0d2df6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:00.984080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:00.984728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:00.985010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:00.985283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:00.985943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:47:00.986244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:00.987610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:00.996126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 589/1189] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:47:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:01.002617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:01.107076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3177496-eba5-4541-9b4f-26af8660063b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:01.142298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:01.142924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:01.143199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:01.143470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] PATH_INFO: `/v3/users/86b2293a7dac435395ac280afdc21bb6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:01.144624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] RBAC: Authorizing `identity:get_user(user_id=86b2293a7dac435395ac280afdc21bb6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:01.146063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:01.147655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 601/1190] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:47:01 2022] GET /identity/v3/users/86b2293a7dac435395ac280afdc21bb6 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:01.154624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:01.235729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:01.260141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab363e3f-fbe5-474d-b429-5aea9601923b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:01.301451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b9e5-441e-4341-8366-2755727ba960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:01.302505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b9e5-441e-4341-8366-2755727ba960 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:01.302984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b9e5-441e-4341-8366-2755727ba960 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:01.303487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b9e5-441e-4341-8366-2755727ba960 None admin] PATH_INFO: `/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:01.305422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179b9e5-441e-4341-8366-2755727ba960 None admin] RBAC: Authorizing `identity:get_project(project_id=4b8ec7c6cce8467a84c3a3160c4dcdc2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:01.307924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179b9e5-441e-4341-8366-2755727ba960 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:01.312033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 590/1191] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:47:01 2022] GET /identity/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:01.318098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:01.341426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:01.426310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2cb2-32f6-4743-9ff7-77f43da2e22b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:01.462081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dc4ab-5739-4898-9532-28c3acd93008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:01.462737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc4ab-5739-4898-9532-28c3acd93008 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:01.463017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc4ab-5739-4898-9532-28c3acd93008 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:01.463291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc4ab-5739-4898-9532-28c3acd93008 None admin] PATH_INFO: `/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2/users/86b2293a7dac435395ac280afdc21bb6/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:01.465986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dc4ab-5739-4898-9532-28c3acd93008 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ec7c6cce8467a84c3a3160c4dcdc2, user_id=86b2293a7dac435395ac280afdc21bb6, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:01.467620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dc4ab-5739-4898-9532-28c3acd93008 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:01.541892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 602/1192] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:47:01 2022] PUT /identity/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2/users/86b2293a7dac435395ac280afdc21bb6/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:47:03.469442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6f41e-055a-45ae-a920-1b40a840fe77 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:03.470009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6f41e-055a-45ae-a920-1b40a840fe77 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:03.470009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6f41e-055a-45ae-a920-1b40a840fe77 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:03.471312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 591/1193] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:47:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:47:03.476922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:03.477405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:03.477706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:03.496807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:03.498082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:03.567722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 603/1194] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:47:03 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:47:03.868426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6f41e-055a-45ae-a920-1b40a840fe77 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:03.970457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6f41e-055a-45ae-a920-1b40a840fe77 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:04.005847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:04.006560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:04.006843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:04.007111 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:04.018033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:47:04.022670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:47:04.023830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:47:04.024857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 592/1195] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:47:04.030661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:04.041051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:04.132988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5329f-b601-4ff2-b4bd-5bcabfaf8508 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:04.167978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:04.169122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:04.169482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:04.169749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:04.170482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:47:04.170779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:04.172185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:04.185296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 604/1196] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:47:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:04.191545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:04.195141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:04.295920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22a81-4f4b-4cec-b521-978f1b9b8e5e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:04.330329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:04.331060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:04.331629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:04.331907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] PATH_INFO: `/v3/users/86b2293a7dac435395ac280afdc21bb6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:04.333057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=86b2293a7dac435395ac280afdc21bb6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:04.334467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:04.336020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 593/1197] 10.222.0.122 () {56 vars in 1182 bytes} [Fri Aug 26 00:47:04 2022] GET /identity/v3/users/86b2293a7dac435395ac280afdc21bb6 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:04.342305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:04.425491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:04.460537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36d3f-88dc-4466-97f8-fb289c4f3355 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:04.503952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:04.504705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:04.504845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:04.505113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:04.573762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:04.575327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:04.646325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:04.679502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 605/1198] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:47:04 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:47:04.687222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:04.757877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:04.789518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90beab-7407-43d2-acb0-7cc657037ce0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:04.824075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724dcd7-5121-4f65-8d71-2258e714150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:04.825013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724dcd7-5121-4f65-8d71-2258e714150c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:04.825288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724dcd7-5121-4f65-8d71-2258e714150c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:04.825554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724dcd7-5121-4f65-8d71-2258e714150c None admin] PATH_INFO: `/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:04.826649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724dcd7-5121-4f65-8d71-2258e714150c None admin] RBAC: Authorizing `identity:get_project(project_id=4b8ec7c6cce8467a84c3a3160c4dcdc2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:04.828064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724dcd7-5121-4f65-8d71-2258e714150c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:04.829690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 594/1199] 10.222.0.122 () {56 vars in 1191 bytes} [Fri Aug 26 00:47:04 2022] GET /identity/v3/projects/4b8ec7c6cce8467a84c3a3160c4dcdc2 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:47:04.836079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:04.940211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba88a-cc31-411e-abfb-f40dd475dfb1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:04.979394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:04.980000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:04.980362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:04.981233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:04.982083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=4b8ec7c6cce8467a84c3a3160c4dcdc2, user.id=86b2293a7dac435395ac280afdc21bb6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:47:04.982385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:04.983820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d2ef-6763-4e9a-8cff-88befaa6ee49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:04.990171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 606/1200] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:47:04 2022] GET /identity/v3/role_assignments?user.id=86b2293a7dac435395ac280afdc21bb6&scope.project.id=4b8ec7c6cce8467a84c3a3160c4dcdc2&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:47:14.819899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=31 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:14.987436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=83 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:24.895306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762be89-9b77-47a2-b5e0-b5789fbef05b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:24.895891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762be89-9b77-47a2-b5e0-b5789fbef05b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:24.895891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762be89-9b77-47a2-b5e0-b5789fbef05b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:24.897200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 595/1201] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:24.902515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:24.906163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:24.906163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:24.923385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:24.924611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:24.991118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 607/1202] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:24 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:25.265597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762be89-9b77-47a2-b5e0-b5789fbef05b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:25.369315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762be89-9b77-47a2-b5e0-b5789fbef05b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:25.402929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:25.403615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:25.403902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:25.404195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:25.415575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:25.425352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:25.431035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:25.432288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:25.433626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:25.433626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:25.433626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:25.433626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 596/1203] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:25.438651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:25.539835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce7de-d881-4c89-a878-f5f621f53167 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:25.568352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:25.573958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:25.574562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:25.582290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:25.582290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:25.582290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:25.582290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:25.582290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952f37e-6fc4-4d60-bb83-d47a67a7f339 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:25.589019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 608/1204] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:25.595154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:25.649254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:25.694762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b63318-fba9-4f16-82a8-9c0c89466fea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:25.729373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bcaa5-2745-4664-b808-9911b6fac1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:25.729972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcaa5-2745-4664-b808-9911b6fac1dc None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:25.730247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcaa5-2745-4664-b808-9911b6fac1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:25.730512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcaa5-2745-4664-b808-9911b6fac1dc None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:25.731144 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bcaa5-2745-4664-b808-9911b6fac1dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:25.732596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bcaa5-2745-4664-b808-9911b6fac1dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:25.825812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 597/1205] 10.222.0.122 () {60 vars in 1137 bytes} [Fri Aug 26 00:48:25 2022] POST /identity/v3/users => generated 252 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:27.825522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eab2f-0a0c-460a-be21-6d8d93ce226f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:27.826082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eab2f-0a0c-460a-be21-6d8d93ce226f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:27.826082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eab2f-0a0c-460a-be21-6d8d93ce226f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:27.827934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 609/1206] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:27.833759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:27.834225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:27.834357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:27.853446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:27.854717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:27.925582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 598/1207] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:27 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:28.199093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eab2f-0a0c-460a-be21-6d8d93ce226f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:28.302042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eab2f-0a0c-460a-be21-6d8d93ce226f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:28.335638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:28.336288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:28.336564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:28.336834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:28.347264 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:48:28.352044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:28.353184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:28.354367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 610/1208] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:48:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:28.359495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:28.400171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:28.459637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb263af-bf75-463c-b010-7e3765541e47 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:28.498827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:28.500309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:28.500668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:28.500939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:28.501588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:28.501884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:28.503237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:28.510918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 599/1209] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:48:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:28.516813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:28.566887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:28.616816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17798c2-b3ee-43a8-a98d-83c1f76db427 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:28.650656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:28.651290 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:28.652064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:28.652369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:28.662846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:28.664358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:28.678899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:28.680072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:28.681033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:28.681033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:28.681033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:28.681033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 611/1210] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:28.685977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:28.783909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:28.786720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51c1c4-7bf1-43e7-82e1-111be432c229 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:28.820721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:28.821322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:28.821603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:28.821870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:28.822498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:28.822798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:28.824198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:28.835854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 600/1211] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:28.841914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:28.948976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a456fe4-2064-4c94-8186-4d12f38c937d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:28.950561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:28.984347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:28.985189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:28.985735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:28.986007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:28.994658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:28.996120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:48:29.007328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:29.008543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:29.009709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 612/1212] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:29.014486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:29.115629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79542142-d5b2-4243-84ec-6a94b3cba450 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:29.149494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:29.150096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:29.150377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:29.150647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:29.151370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:29.151712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:29.153230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:29.170816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 601/1213] 10.222.0.122 () {56 vars in 1148 bytes} [Fri Aug 26 00:48:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:29.177336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:29.281025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b936f-ef5a-4d9d-8304-2f999bc702d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:29.316800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:29.317399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:29.317670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:29.317968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:29.349743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:29.388456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:29.389824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:29.489463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 613/1214] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:48:29 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:48:29.495336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:29.514710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:29.596185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8ae1-2412-4ac9-a164-3712cca35f2c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:29.630253 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:29.630881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:29.631164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:29.631436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:29.641551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:29.643739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:29.663464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:29.664792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:29.665897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:29.665897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:29.665897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:29.665897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 602/1215] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:29.670719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:29.733749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:29.772372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddab58-9883-47dc-a98e-9e851855e0f3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:29.806591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:29.807186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:29.807460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:29.807726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:29.808382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:29.808677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:29.810059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:29.821679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 614/1216] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:29.827393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:29.899073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:29.931409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c74007-de5d-462c-9abb-9a3dd24064a4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:29.966436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:29.967088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:29.967366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:29.967632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:29.975241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:29.980427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:48:29.990434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:29.991545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:29.992579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 603/1217] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:29.997536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:30.099676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892be0a8-b15a-49fc-9cee-54fda34cb6dd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:30.122594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:30.134379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:30.134977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:30.135251 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:30.135518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:30.136235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:30.136534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:30.138073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d3c25-b1fc-4e6a-a801-080d76feec91 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:30.150045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 615/1218] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:48:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:30.156125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:30.258651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b98f-942f-4293-a23d-8efd83cf8b61 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:30.287250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:30.292966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:30.293614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:30.293868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:30.294179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:30.294893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=2d8983239be74a3b86f60693bd8570cd) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:30.295192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:30.296665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a417a-b9f2-4040-b2f4-77b267476a72 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:30.302603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 604/1219] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:48:30 2022] GET /identity/v3/role_assignments?user.id=2d8983239be74a3b86f60693bd8570cd&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 260 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:32.208895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5d45-e5b8-4bb1-b356-79932b03329b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:32.209434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5d45-e5b8-4bb1-b356-79932b03329b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:32.209434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5d45-e5b8-4bb1-b356-79932b03329b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:32.210754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 616/1220] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:32.215859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:32.216280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:32.216438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:32.235407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:32.236618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:32.313963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 605/1221] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:32 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:32.590815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5d45-e5b8-4bb1-b356-79932b03329b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:32.696339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5d45-e5b8-4bb1-b356-79932b03329b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:32.730950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:32.732519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:32.732519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:32.732519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:32.742451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:48:32.747121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:32.748300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:32.749623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 617/1222] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:48:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:32.755189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:32.854772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174279b5-624d-44ee-a106-1a94ef5375c4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:32.879252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:32.889645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:32.890256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:32.890536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:32.890807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:32.891461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:32.891763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:32.893158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:32.900880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 606/1223] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:48:32 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:32.907114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:32.952782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:33.008513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a437-1501-43f0-b8d0-c8f697ef19d1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:33.042069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:33.042847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:33.043123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:33.043391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:33.054168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:33.055645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:33.070238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:33.071366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:33.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:33.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:33.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:33.072420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 618/1224] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:33.077299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:33.178647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5733-58c3-41f6-a595-fa5fc74e95cf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:33.211819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:33.212436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:33.212715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:33.212989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:33.213614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:33.213913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:33.215258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:33.227408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 607/1225] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:33.233250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:33.327195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:33.333683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c410-fa2f-419b-bb62-89a226a993b0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:33.367857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:33.368503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:33.368776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:33.369044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:33.376420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:33.377946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:48:33.388924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:33.389957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:33.391106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 619/1226] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:33.396206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:33.444500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:33.497209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f50d1a-ba18-4bda-ac68-eb603f365af8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:33.529512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:33.530102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:33.530380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:33.530648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:33.531350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:33.531699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:33.533137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:33.551975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 608/1227] 10.222.0.122 () {56 vars in 1148 bytes} [Fri Aug 26 00:48:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:33.557676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:33.658732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25f72-6766-4be5-968c-89579678c0ea None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:33.693266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:33.693885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:33.694159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:33.694423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:33.706314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:33.707897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:33.722861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:33.723937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:33.724946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:33.724946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:33.724946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:33.724946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 620/1228] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:33.729830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:33.842195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f434-a084-4d08-9cf6-ffef018a0b53 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:33.844684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:33.878474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:33.879077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:33.879351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:33.879612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:33.880281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:33.880587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:33.882402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:33.893998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 609/1229] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:33.900096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:33.910461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:34.002278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c536-6976-47f7-a130-51eaf96dbb9d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:34.037020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:34.037644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:34.037916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:34.038181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:34.044823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:34.046351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:48:34.058177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:34.059182 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:34.060092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 621/1230] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:34.065377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:34.166803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3cca4-1849-48d4-92aa-6d824e1750e2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:34.200113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:34.200783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:34.201022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:34.201293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:34.201972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:34.202274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:34.203727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65821-f75c-4fdd-97a6-5a2fb8f7accb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:34.215660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 610/1231] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:48:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:48:34.222460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:34.287679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:34.322366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea27a-c4bb-423b-984d-4d506e406bb8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:34.355395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c95a-7818-451a-b712-d6fea35e6e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:34.356054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c95a-7818-451a-b712-d6fea35e6e2e None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:34.356354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c95a-7818-451a-b712-d6fea35e6e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:34.356627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c95a-7818-451a-b712-d6fea35e6e2e None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/2d8983239be74a3b86f60693bd8570cd/roles/70cc4051867c46d089a1deca4575bc7e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:34.372465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686c95a-7818-451a-b712-d6fea35e6e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=2d8983239be74a3b86f60693bd8570cd, role_id=70cc4051867c46d089a1deca4575bc7e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:34.373905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686c95a-7818-451a-b712-d6fea35e6e2e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:34.466714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 622/1232] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:48:34 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/2d8983239be74a3b86f60693bd8570cd/roles/70cc4051867c46d089a1deca4575bc7e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:36.418252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3daf5-9ec6-4c6b-b17b-ebf9704e9dc8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:36.418829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3daf5-9ec6-4c6b-b17b-ebf9704e9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:36.418829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3daf5-9ec6-4c6b-b17b-ebf9704e9dc8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:36.420085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 611/1233] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:36.425986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:36.426410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:36.426528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:36.444978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:36.446153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:36.513528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 623/1234] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:36 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:36.785397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3daf5-9ec6-4c6b-b17b-ebf9704e9dc8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:36.810903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:36.887690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3daf5-9ec6-4c6b-b17b-ebf9704e9dc8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:36.921644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:36.922266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:36.922551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:36.922822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:36.933237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:48:36.937993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:36.938963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:36.941099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 612/1235] 10.222.0.122 () {56 vars in 1107 bytes} [Fri Aug 26 00:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:36.946923 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:36.994330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:37.048504 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86b708-cdad-4dce-bca5-0481110500ef None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.083282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.083895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.084199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.084472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.085136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:37.085434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.086829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:37.094956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 624/1236] 10.222.0.122 () {56 vars in 1108 bytes} [Fri Aug 26 00:48:36 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:37.101825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.186277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:37.202482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113cc7b-b992-4e5e-bb9b-933d91733be4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.235944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.237475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.237773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.238356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.248681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.250109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:37.266140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:37.267308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:37.268410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:37.268410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:37.268410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:37.268410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 613/1237] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:37.274224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.377627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd003d86-9b43-4993-9501-c570c5d4128d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.386639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:37.411638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.412265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.412542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.412811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.413440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:37.413736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.415093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:37.428042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 625/1238] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:37.434061 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.535246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd13088-f40e-481d-b3ab-63b85c1baeec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.568168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.568797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.569074 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.569343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.571943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:37.576983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.578403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:48:37.589827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:37.593874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:37.595180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 614/1239] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:37.597672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.698309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c0ba-abbb-4d80-9e84-af03e0b7bcca None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.733496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.734100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.734639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.734908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.735619 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:37.735919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.737755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:37.755365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 626/1240] 10.222.0.122 () {56 vars in 1148 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:37.761327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.862609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edc811-9541-4f25-aa40-bae8f711ba76 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.896584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.897180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.897455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.897724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.959804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:37.966360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.968026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.065325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 615/1241] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:48:38.071393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:38.099907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:38.172445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99632730-4c41-441b-94bc-efa538b43413 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:38.207230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:38.207843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:38.208116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:38.208412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:38.218102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:38.219529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:38.233653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:38.235059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:38.236203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:38.236203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:38.236203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:38.236203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 627/1242] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:38.241514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:38.363357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:38.369368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a232a8-5bb2-4e1c-9094-7f4dc8c31306 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:38.405435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:38.406060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:38.406357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:38.406631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:38.407271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:38.407598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:38.409014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.420408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 616/1243] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:38.428876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:38.514838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:38.538168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa7ad2-fb7c-4fed-b7d3-a80eeccc4f9e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:38.572386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:38.573006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:38.573285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:38.573556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:38.579932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:38.583883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:48:38.592698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:38.593763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:38.595071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 628/1244] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:38.600320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:38.701776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396a752-e966-4bc2-8fb2-d783bd681774 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:38.734829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:38.735414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:38.735689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:38.735953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:38.737324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:38.737644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:38.739054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6535fab-bef1-4fe6-8160-430a4b47d797 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.750735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 617/1245] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:38.757147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:38.858371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a5c17-2902-4598-abb5-0ec0f665a58f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:38.894525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:38.899821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:38.899821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:38.899821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:38.899821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] RBAC: Adding query filter params (role.id=70cc4051867c46d089a1deca4575bc7e, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=2d8983239be74a3b86f60693bd8570cd) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:38.899821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:38.899821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cafe4-519a-4f4b-b011-5fdb05fb8511 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.904174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 629/1246] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:48:38 2022] GET /identity/v3/role_assignments?user.id=2d8983239be74a3b86f60693bd8570cd&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=70cc4051867c46d089a1deca4575bc7e => generated 610 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:40.888927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901367-c98b-409e-a42d-36bf2baec344 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:40.889519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901367-c98b-409e-a42d-36bf2baec344 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:40.889519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901367-c98b-409e-a42d-36bf2baec344 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:40.890784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 618/1247] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:40.896925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:40.897384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:40.897496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:40.903688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:40.916617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:40.917804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:40.989663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 630/1248] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:40 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:41.264220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61901367-c98b-409e-a42d-36bf2baec344 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:41.282648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:41.372102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61901367-c98b-409e-a42d-36bf2baec344 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:41.406312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:41.406938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:41.407220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:41.407494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:41.418237 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:48:41.422905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:41.424328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:41.425367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 619/1249] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:48:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:41.430030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:41.528621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6eae8-1390-441c-a2c5-fcfef3a0ee7b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:41.557226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:41.561928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:41.562525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:41.562802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:41.563073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:41.563721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:41.564019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:41.566298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:41.574023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 631/1250] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:48:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:41.579703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:41.657351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:41.681606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47d04f-84a5-4d38-b2a3-0173cd6dc81d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:41.715954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:41.716613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:41.716893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:41.717163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:41.727695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:41.729154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:41.743277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:41.744383 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:41.745684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:41.745684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:41.745684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:41.745684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 620/1251] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:41.750317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:41.850711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ade73-0f01-4deb-b3be-4d08c866cd85 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:41.885728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:41.886337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:41.886618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:41.886892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:41.887527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:41.887830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:41.889332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:41.901313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 632/1252] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:41.907228 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:42.007680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb770a78-6722-4275-be82-ab1e7b44d5fd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:42.035017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:42.042725 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:42.043351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:42.043641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:42.043925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:42.052023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:42.053482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:48:42.065034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:42.066216 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:42.067277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 621/1253] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:42.072130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:42.129516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:42.173212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed135ee-2b66-4cf0-964f-a9c791d2fc63 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:42.211186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:42.211792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:42.212070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:42.212368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:42.213178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:42.213431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:42.214852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:42.232223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 633/1254] 10.222.0.122 () {56 vars in 1148 bytes} [Fri Aug 26 00:48:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:42.239267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:42.341188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400e3d-8bc2-4589-8c5a-8ef673269a81 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:42.375868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:42.376532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:42.376997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:42.377395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:42.432548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:42.444604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:42.446049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:42.543669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 622/1255] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:48:42 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:48:42.550440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:42.650848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec37a8-9dae-409b-a424-08335fe52d92 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:42.664771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:42.685730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:42.686294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:42.686569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:42.686838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:42.697734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:42.699187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:42.718262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:42.719482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:42.721448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:42.721448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:42.721448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:42.721448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 634/1256] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:42.726805 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:42.815233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:42.826673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6212-9e48-4214-8cd0-b1e473e525b5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:42.861593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:42.862195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:42.862469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:42.862739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:42.863395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:42.863713 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:42.865083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:42.876263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 623/1257] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:42.882179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:42.986974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd6a1-e55e-40d2-a949-07c6f3fbe54d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:43.022166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:43.022787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:43.023067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:43.023338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:43.029835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:43.031271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:48:43.042397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:43.043474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:43.044754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 635/1258] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:43.049660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:43.151188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9350c6-b0fa-43ff-8f2b-6f8ce7a30be1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:43.184281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:43.184886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:43.185161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:43.185432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:43.186114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:43.186416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:43.187835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d240ecb-9def-43a0-a810-1349fb96522e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:43.200415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 624/1259] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:43.207372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:43.232986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:43.306553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2b69-9b3e-4e9f-9b35-1aa02b0c36e2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:43.340554 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:43.341157 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:43.341438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:43.341714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:43.342433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=2d8983239be74a3b86f60693bd8570cd) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:43.342736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:43.344189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d98027-a46e-4468-b8c8-a3b2685955ee None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:43.349731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 636/1260] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:48:43 2022] GET /identity/v3/role_assignments?user.id=2d8983239be74a3b86f60693bd8570cd&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:45.254495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225734ac-ed67-4630-966e-4571699a92ab None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:45.296659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225734ac-ed67-4630-966e-4571699a92ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:45.296659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225734ac-ed67-4630-966e-4571699a92ab None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:45.296659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 625/1261] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:45.296977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:45.296977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:45.296977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:45.296977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:45.296977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:45.348937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 637/1262] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:45 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:45.624874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225734ac-ed67-4630-966e-4571699a92ab None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:45.636000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:45.727585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225734ac-ed67-4630-966e-4571699a92ab None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:45.760910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:45.761592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:45.761871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:45.762141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:45.772709 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:48:45.777381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:45.783532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:45.784545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 626/1263] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:48:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:45.785305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:45.805527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:45.886704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0bf4-b730-4914-91f4-e0677546104e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:45.922328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:45.922930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:45.923226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:45.923500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:45.924327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:45.924626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:45.926009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:45.934056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 638/1264] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:48:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:45.941125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.007727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:46.040868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c78ea-6fa0-4aa8-b9ec-6dd2c5c574c4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:46.074566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:46.075186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:46.075461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:46.075730 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:46.086768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.092562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:46.103023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:46.104233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:46.105653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:46.105653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:46.105653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:46.105653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 627/1265] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:48:46.110318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.194078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:46.213972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe6c6-10d2-4e2c-b006-0809aafbfbb9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:46.247642 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:46.248275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:46.248558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:46.248835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:46.249470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:46.249770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.251134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.265220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 639/1266] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:46.271945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.372323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee600-7e55-4029-a2eb-7094135a7fad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:46.392313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:46.405691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:46.406310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:46.406590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:46.406858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:46.414396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.415831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:48:46.427129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:46.428526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:46.429738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 628/1267] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:46.434168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.535807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251404b8-27de-491b-bdd5-b4c447561ffd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:46.570388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:46.574480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:46.574480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:46.574480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:46.574480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:46.574480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.574480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.582845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:46.591101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 640/1268] 10.222.0.122 () {56 vars in 1148 bytes} [Fri Aug 26 00:48:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:46.597064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.696900 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc2b5-f531-448a-a787-c0b9f7b03b8e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:46.731891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:46.732581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:46.732880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:46.733160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:46.743825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.745289 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:46.759637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:46.760914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:46.762021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:46.762021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:46.762021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:46.762021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 629/1269] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:46.766826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.868176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d926-bafb-498f-bc25-00add6f3c803 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:46.902498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:46.903098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:46.903373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:46.903640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:46.904292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:46.904589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.905943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.917196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 641/1270] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:46.923324 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:46.955804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:47.022445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84f820-f2bd-4b03-a50a-0b7056d1592b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:47.054827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:47.055444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:47.055716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:47.055982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:47.062433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:47.068620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:48:47.075616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:47.076784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:47.077913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 630/1271] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:48:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:47.083584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:47.142893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:47.184387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be766a-4f30-49d6-a0d2-15025fb9dc9e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:47.217924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:47.218515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:47.218787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:47.219052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:47.219727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:47.220023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:47.221561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbfb4-43ab-4fd3-a719-6351da5ebebe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:47.233058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 642/1272] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:47.240581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:47.337098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:47.345399 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591080c-8974-4e8c-9eca-a362301c146f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:47.378585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9252-be7a-400b-949e-82e386b093c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:47.379226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9252-be7a-400b-949e-82e386b093c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:47.379537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9252-be7a-400b-949e-82e386b093c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:47.379770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9252-be7a-400b-949e-82e386b093c8 None admin] PATH_INFO: `/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/2d8983239be74a3b86f60693bd8570cd/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:47.381686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e9252-be7a-400b-949e-82e386b093c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5259c7e6dd224f0a98a327306199f4af, user_id=2d8983239be74a3b86f60693bd8570cd, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:47.385784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e9252-be7a-400b-949e-82e386b093c8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:47.521065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 631/1273] 10.222.0.122 () {58 vars in 1444 bytes} [Fri Aug 26 00:48:47 2022] PUT /identity/v3/projects/5259c7e6dd224f0a98a327306199f4af/users/2d8983239be74a3b86f60693bd8570cd/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:49.430957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c13a-36fa-4d47-91da-b1b4414baf77 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.431556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c13a-36fa-4d47-91da-b1b4414baf77 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.431556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c13a-36fa-4d47-91da-b1b4414baf77 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.432864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 643/1274] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:49.438215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.438634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.441984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.457018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:49.458183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:49.525578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 632/1275] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:49 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:49.802736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c13a-36fa-4d47-91da-b1b4414baf77 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.904718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c13a-36fa-4d47-91da-b1b4414baf77 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.922628 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:49.940633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.946820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.946820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.946820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.952145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:48:49.957206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:49.958313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:49.959332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 644/1276] 10.222.0.122 () {56 vars in 1101 bytes} [Fri Aug 26 00:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:49.964515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.045716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:50.063908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8b56-a5a1-41c0-8fac-c02e77dda92d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.099230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.099852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.100129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.100430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.101090 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:50.101390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.102775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.112055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 633/1277] 10.222.0.122 () {56 vars in 1104 bytes} [Fri Aug 26 00:48:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:50.118089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.218818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71803-49f7-4921-9f71-99a3bb2bc851 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.253629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.254252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.254525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.254791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.264697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.266150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:50.281206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:50.282386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:50.284252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:50.284252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:50.284252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:50.284252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 645/1278] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:50.289998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.390972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4725ec-ad27-4e44-88bf-9ced137be772 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.430534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.431128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.431403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.431668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.432319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:50.432616 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.433960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.445491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 634/1279] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:50.451531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.483898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:50.554220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf98d7-5819-47dc-b6bc-433f3cc7001f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.589271 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.589906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.590186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.590460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.598049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.599515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:48:50.610791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:50.613540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:50.615637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 646/1280] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:50.620933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.625510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:50.722917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a12da7-7a5b-4a23-8f29-0ac068c32ce3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.757301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.757831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.758113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.758387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.759108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:50.759414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.760899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.778783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 635/1281] 10.222.0.122 () {56 vars in 1148 bytes} [Fri Aug 26 00:48:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:50.784777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.873840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:50.884227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8ff1a-ae07-40c0-900a-f51add01701f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.916346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.916944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.917219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.917491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.985155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.987502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.081662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:51.092544 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 647/1282] 10.222.0.122 () {58 vars in 1287 bytes} [Fri Aug 26 00:48:50 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:48:51.098816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.162580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:51.201080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369265f9-1d6d-459e-bfa8-404ea610f35e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.235307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.235948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.236798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.237070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.246889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.248404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:48:51.262588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:51.263724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:48:51.265162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:48:51.265162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:48:51.265162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:51.265162 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 636/1283] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:51.269797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.372417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813301e-10ef-4a55-b989-5d37815fdc52 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.406887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.407486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.407765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.408595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.409230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:51.409529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.410973 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.422169 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 648/1284] 10.222.0.122 () {56 vars in 1114 bytes} [Fri Aug 26 00:48:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:51.428489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.526772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209c75-d948-4696-80d4-e67cc94abbf4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.540826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:51.560968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.561701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.561979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.562244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.569358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.570790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:48:51.582089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:51.586899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 26 00:48:51.587981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 637/1285] 10.222.0.122 () {56 vars in 1116 bytes} [Fri Aug 26 00:48:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:51.589141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.639935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:51.690449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0b470-623d-48bc-af72-aa64e447e932 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.724862 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.725463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.725739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.726008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.726683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:51.726984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.728589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b40790-cc0e-4e88-85c7-dcb8a931b8a6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.741278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 649/1286] 10.222.0.122 () {56 vars in 1153 bytes} [Fri Aug 26 00:48:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:51.747116 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.849344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12638b97-7cec-49ef-92d3-c185889bc296 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.881803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.882395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.882670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.882936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.883661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] RBAC: Adding query filter params (role.id=efabcc00ebde48babd14a43e59a6e6b0, scope.project.id=5259c7e6dd224f0a98a327306199f4af, user.id=2d8983239be74a3b86f60693bd8570cd) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:51.883962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.885433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e24ed5-0406-41c4-956a-4e8130fd879e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.891131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 638/1287] 10.222.0.122 () {56 vars in 1379 bytes} [Fri Aug 26 00:48:51 2022] GET /identity/v3/role_assignments?user.id=2d8983239be74a3b86f60693bd8570cd&scope.project.id=5259c7e6dd224f0a98a327306199f4af&role.id=efabcc00ebde48babd14a43e59a6e6b0 => generated 610 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:53.858484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b5f8-9370-46c1-a66e-33e2dc123697 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:53.859018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b5f8-9370-46c1-a66e-33e2dc123697 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:53.859018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b5f8-9370-46c1-a66e-33e2dc123697 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:53.860703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 650/1288] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:53.866384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:53.866778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:53.866965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:53.885772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:53.886953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:53.916132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:53.953196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 639/1289] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:53 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:54.232646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b5f8-9370-46c1-a66e-33e2dc123697 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.335780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b5f8-9370-46c1-a66e-33e2dc123697 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.347443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:54.371861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.372520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.372798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.373238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.373785 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.375149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:54.383912 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:54.385498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:54.386392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 651/1290] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:54.391501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.493869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14797-2fb6-447c-893b-c943619659cd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.527681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.528308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.528587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.528855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.529473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:54.529817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.531210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cfa91-981c-4183-a490-22543201ab4f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.536477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 640/1291] 10.222.0.122 () {56 vars in 1121 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:54.542317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.644020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c5734-7539-4125-b7a8-21762cbcbf65 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.678666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.679262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.679536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.679802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.680486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:54.680810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.682164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f159ce-377b-4b81-af15-5937003f519f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.686545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 652/1292] 10.222.0.122 () {56 vars in 1121 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:56.613689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0ed7-1fcb-4182-b85b-51a9eb7a3208 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:56.614315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0ed7-1fcb-4182-b85b-51a9eb7a3208 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:56.614315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0ed7-1fcb-4182-b85b-51a9eb7a3208 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:56.615545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 641/1293] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:56.620762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8768f1-0bac-4bf4-a3b3-65c91130c618 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:56.621171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8768f1-0bac-4bf4-a3b3-65c91130c618 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:56.621316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8768f1-0bac-4bf4-a3b3-65c91130c618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:56.639632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5d8768f1-0bac-4bf4-a3b3-65c91130c618 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:56.640914 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5d8768f1-0bac-4bf4-a3b3-65c91130c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:56.671972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:56.712214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 653/1294] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:56 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:56.985051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0ed7-1fcb-4182-b85b-51a9eb7a3208 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.016796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:57.086865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0ed7-1fcb-4182-b85b-51a9eb7a3208 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.122397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d303850-e696-4a56-925c-4311c60fcd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.123220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303850-e696-4a56-925c-4311c60fcd55 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.123348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303850-e696-4a56-925c-4311c60fcd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.123532 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303850-e696-4a56-925c-4311c60fcd55 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.124209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d303850-e696-4a56-925c-4311c60fcd55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.125583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d303850-e696-4a56-925c-4311c60fcd55 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.232986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 642/1295] 10.222.0.122 () {60 vars in 1146 bytes} [Fri Aug 26 00:48:56 2022] POST /identity/v3/services => generated 247 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:59.148231 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf228ee-d2d1-4d75-bb18-04c99756c58c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:59.148787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf228ee-d2d1-4d75-bb18-04c99756c58c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:59.148787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf228ee-d2d1-4d75-bb18-04c99756c58c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:59.150106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 654/1296] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:48:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:48:59.155489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:59.155892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:59.156029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:59.175871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:59.177094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:59.250435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 643/1297] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:48:59 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:48:59.528306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf228ee-d2d1-4d75-bb18-04c99756c58c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:59.636432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf228ee-d2d1-4d75-bb18-04c99756c58c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:59.671942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:59.672604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:59.672881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:59.673149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:59.673728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:59.675360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:48:59.684559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:48:59.685773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:48:59.686702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 655/1298] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:48:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:48:59.692659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:59.716411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:59.797423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9bbd6-6ae1-4fc3-ab2b-5903e382d11d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:59.831373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:59.833346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:59.833346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:59.833346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:59.833346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:59.833786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:59.834990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:59.840003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 644/1299] 10.222.0.122 () {56 vars in 1121 bytes} [Fri Aug 26 00:48:59 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:59.846019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:59.878807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:59.947341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddeb15-2625-44a4-88c6-4c3a2d46aea5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:59.983344 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:59.983963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:59.984306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:59.984834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:59.985592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] RBAC: Adding query filter params (interface=public, service_id=64374aad78344a59a8cc6502020ca634, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:59.985898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:59.987681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e872ca-532d-4280-adf8-57c857a30dbb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:59.992548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 656/1300] 10.222.0.122 () {56 vars in 1256 bytes} [Fri Aug 26 00:48:59 2022] GET /identity/v3/endpoints?service_id=64374aad78344a59a8cc6502020ca634&interface=public®ion_id=RegionOne => generated 195 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:59.998545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:00.083067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:00.103340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319af0f-1c46-4ac5-b167-bad30d4fa74d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:00.141753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f606b-d9b0-45a6-a3f8-b11c29c402e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:00.142374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f606b-d9b0-45a6-a3f8-b11c29c402e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:00.142653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f606b-d9b0-45a6-a3f8-b11c29c402e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:00.142925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f606b-d9b0-45a6-a3f8-b11c29c402e5 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:00.144130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f606b-d9b0-45a6-a3f8-b11c29c402e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:00.146215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f606b-d9b0-45a6-a3f8-b11c29c402e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:00.153769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 645/1301] 10.222.0.122 () {56 vars in 1092 bytes} [Fri Aug 26 00:48:59 2022] GET /identity/v3/services => generated 2201 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:49:02.102937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d062-14bf-44f1-bb80-a003b91941b9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:02.103491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d062-14bf-44f1-bb80-a003b91941b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:02.103491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863d062-14bf-44f1-bb80-a003b91941b9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:02.104925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 657/1302] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:49:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:02.110585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:02.111058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:02.111155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:02.131077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:02.135776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:02.200823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 646/1303] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:02 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:49:02.478049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d062-14bf-44f1-bb80-a003b91941b9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:02.575018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:02.582524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863d062-14bf-44f1-bb80-a003b91941b9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:02.615269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:02.615884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:02.616181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:02.616451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:02.617016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:02.618401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:02.627209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:02.632827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 26 00:49:02.633678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 658/1304] 10.222.0.122 () {56 vars in 1122 bytes} [Fri Aug 26 00:49:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:02.635415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:02.712800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:02.734329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a83f4e-79cb-4847-bcab-7f2953071db5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:02.766853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:02.767441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:02.767717 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:02.768294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:02.769203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:02.769506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:02.770945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9177f85-cc9c-4af5-ab31-783c86a59bd5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:02.775855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 647/1305] 10.222.0.122 () {56 vars in 1121 bytes} [Fri Aug 26 00:49:02 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:02.781907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:02.883343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f32e1-5fe9-441d-a20d-6180ff0ea1d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:02.918602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50085e06-110c-4529-a77f-c4b188d64f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:02.919210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50085e06-110c-4529-a77f-c4b188d64f8b None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:02.919486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50085e06-110c-4529-a77f-c4b188d64f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:02.919757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50085e06-110c-4529-a77f-c4b188d64f8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:02.920444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50085e06-110c-4529-a77f-c4b188d64f8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:02.921806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50085e06-110c-4529-a77f-c4b188d64f8b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:03.011503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 659/1306] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 00:49:02 2022] POST /identity/v3/endpoints => generated 333 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:12.798066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=30 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:13.006218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:51.353248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a91c-2091-49af-ab55-e2015816103e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:51.353248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a91c-2091-49af-ab55-e2015816103e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:51.353248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a91c-2091-49af-ab55-e2015816103e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:51.355580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 648/1307] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:56:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:56:51.362820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6a12-76c9-405c-989a-d8e77ed0f4e5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:51.363257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6a12-76c9-405c-989a-d8e77ed0f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:51.363686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6a12-76c9-405c-989a-d8e77ed0f4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:51.596749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3bdf6a12-76c9-405c-989a-d8e77ed0f4e5 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:51.597881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3bdf6a12-76c9-405c-989a-d8e77ed0f4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:51.739050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 660/1308] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:52.057939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d669-10f2-47d2-b97e-38432186721d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:52.058241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d669-10f2-47d2-b97e-38432186721d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:52.058515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d669-10f2-47d2-b97e-38432186721d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:52.059884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 649/1309] 10.222.0.122 () {54 vars in 970 bytes} [Fri Aug 26 00:56:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:56:52.067484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6979c-4143-48e5-bce0-fcf8f1b585d0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:52.067868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6979c-4143-48e5-bce0-fcf8f1b585d0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:52.068191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6979c-4143-48e5-bce0-fcf8f1b585d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:52.168342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e4c6979c-4143-48e5-bce0-fcf8f1b585d0 None None] MFA Rules not processed for user `74c23495decd4d5e8a0a8ae47935ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:52.169865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e4c6979c-4143-48e5-bce0-fcf8f1b585d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:52.199222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:52.263849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 661/1310] 10.222.0.122 () {58 vars in 1067 bytes} [Fri Aug 26 00:56:52 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:52.273917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d669-10f2-47d2-b97e-38432186721d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:52.275885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-deb5d669-10f2-47d2-b97e-38432186721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:52.432241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d669-10f2-47d2-b97e-38432186721d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:52.591672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:52.593221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:52.594598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:52.595755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:52.599281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:52.676373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:52.745129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:52.746990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b47d00-e488-4653-ae1c-1b19bced46c7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:52.774527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 650/1311] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:56:55.335040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379d52-2191-4818-b152-7536010b70ad None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:55.335513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379d52-2191-4818-b152-7536010b70ad None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:55.335605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85379d52-2191-4818-b152-7536010b70ad None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:55.337304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 662/1312] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:56:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:56:55.344609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e02d-2ff8-4250-994c-46812253567f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:55.345113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e02d-2ff8-4250-994c-46812253567f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:55.345595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59e02d-2ff8-4250-994c-46812253567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:55.449408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2b59e02d-2ff8-4250-994c-46812253567f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:55.450677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2b59e02d-2ff8-4250-994c-46812253567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:55.558784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 651/1313] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:56:55.855789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379d52-2191-4818-b152-7536010b70ad None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:55.857444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85379d52-2191-4818-b152-7536010b70ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:55.980769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85379d52-2191-4818-b152-7536010b70ad None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:56.057844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:56.060521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:56.061137 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:56.061413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:56.061735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:56.063517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:56.212596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:56.213957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb678-0b02-4e45-b110-6c79c8197ff5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:56.236065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 663/1314] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:56:58.815063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27faa19-80f5-4e37-8ccf-e7ea47542bc0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:58.815660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27faa19-80f5-4e37-8ccf-e7ea47542bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:58.815660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27faa19-80f5-4e37-8ccf-e7ea47542bc0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:58.817038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 652/1315] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:56:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:56:58.823743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a10079-14f8-4681-a0c8-9b35f1da7ff8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:58.823743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a10079-14f8-4681-a0c8-9b35f1da7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:58.824452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a10079-14f8-4681-a0c8-9b35f1da7ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:58.913778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-88a10079-14f8-4681-a0c8-9b35f1da7ff8 None None] MFA Rules not processed for user `bf533d414187425ea006e350f6b6f292`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:58.915021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-88a10079-14f8-4681-a0c8-9b35f1da7ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:58.971117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:59.019524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 664/1316] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:56:59.301779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27faa19-80f5-4e37-8ccf-e7ea47542bc0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:59.303348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a27faa19-80f5-4e37-8ccf-e7ea47542bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:59.313316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:59.415387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27faa19-80f5-4e37-8ccf-e7ea47542bc0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:59.490033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:59.490638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:59.490913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:59.491188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:59.492812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:59.559400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:59.612643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:59.614089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de635b9-c0ec-4688-a19b-9fd3cd9226f6 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:59.633601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 653/1317] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:56:59 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:02.508178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887bc27-3f7c-4f56-ba2d-55963f2fc827 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:02.508734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887bc27-3f7c-4f56-ba2d-55963f2fc827 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:02.508734 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887bc27-3f7c-4f56-ba2d-55963f2fc827 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:02.510078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 665/1318] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:02.516129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7686f-f71a-483a-a38c-ea0dd0d10e22 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:02.517086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7686f-f71a-483a-a38c-ea0dd0d10e22 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:02.517086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7686f-f71a-483a-a38c-ea0dd0d10e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:02.585560 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4af7686f-f71a-483a-a38c-ea0dd0d10e22 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:02.586767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4af7686f-f71a-483a-a38c-ea0dd0d10e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:02.688391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 654/1319] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:02.976184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887bc27-3f7c-4f56-ba2d-55963f2fc827 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:02.977700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4887bc27-3f7c-4f56-ba2d-55963f2fc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:03.084171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887bc27-3f7c-4f56-ba2d-55963f2fc827 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:03.160125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:03.160754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:03.161028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:03.161293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:03.162883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:03.170558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:03.281478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:03.282839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5c086-4526-4524-9277-06174e6e013e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:03.301857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 666/1320] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:06.464119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2362cb5-42b1-4682-8730-c14a01de0512 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:06.464753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2362cb5-42b1-4682-8730-c14a01de0512 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:06.464753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2362cb5-42b1-4682-8730-c14a01de0512 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:06.466031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 655/1321] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:06.472861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134332e3-fc49-477d-a684-6cf1b5128ceb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:06.473398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134332e3-fc49-477d-a684-6cf1b5128ceb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:06.473398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134332e3-fc49-477d-a684-6cf1b5128ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:06.556787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-134332e3-fc49-477d-a684-6cf1b5128ceb None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:06.558005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-134332e3-fc49-477d-a684-6cf1b5128ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:06.630947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:06.677330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 667/1322] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:57:06.993334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7723-05e2-45be-94db-bc1c4e0f558a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:06.993621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7723-05e2-45be-94db-bc1c4e0f558a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:06.993896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7723-05e2-45be-94db-bc1c4e0f558a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:06.995246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 656/1323] 10.222.0.122 () {54 vars in 970 bytes} [Fri Aug 26 00:57:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:07.003049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548b895-75cd-43db-99dd-108f53af1e0e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:07.003389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548b895-75cd-43db-99dd-108f53af1e0e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:07.003748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548b895-75cd-43db-99dd-108f53af1e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:07.095997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4548b895-75cd-43db-99dd-108f53af1e0e None None] MFA Rules not processed for user `74c23495decd4d5e8a0a8ae47935ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:07.097631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4548b895-75cd-43db-99dd-108f53af1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:07.189702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 668/1324] 10.222.0.122 () {58 vars in 1067 bytes} [Fri Aug 26 00:57:07 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:07.199003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f7723-05e2-45be-94db-bc1c4e0f558a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:07.200575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-530f7723-05e2-45be-94db-bc1c4e0f558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:07.331099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:07.331099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f7723-05e2-45be-94db-bc1c4e0f558a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:07.407027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:07.407640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:07.407922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:07.408218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:07.410070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:07.486835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:07.529786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:07.531909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693155c0-5f0c-4a8f-9c52-52e4b9791eaa service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:07.553172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 657/1325] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:09.843697 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71957039-6db6-49ce-aeb7-2ddb6682a4c5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:09.844262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71957039-6db6-49ce-aeb7-2ddb6682a4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:09.844262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71957039-6db6-49ce-aeb7-2ddb6682a4c5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:09.845924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 669/1326] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:09.851246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af24720-5ac8-4dd4-a447-5c66c6f52e39 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:09.851723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af24720-5ac8-4dd4-a447-5c66c6f52e39 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:09.851830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af24720-5ac8-4dd4-a447-5c66c6f52e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:09.927218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8af24720-5ac8-4dd4-a447-5c66c6f52e39 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:09.928494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8af24720-5ac8-4dd4-a447-5c66c6f52e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:10.034012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 658/1327] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:10.325286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71957039-6db6-49ce-aeb7-2ddb6682a4c5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:10.327687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-71957039-6db6-49ce-aeb7-2ddb6682a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:10.393588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:10.440340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71957039-6db6-49ce-aeb7-2ddb6682a4c5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:10.528626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:10.529843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:10.530120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:10.530386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:10.532027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:10.661704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:10.663878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:10.665387 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6504-62c2-4b27-b4c2-40a76c52310c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:10.685129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 670/1328] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:10 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:57:12.674609 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32847-ea3e-4c18-9a6a-7e10efdeea2c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:12.675178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32847-ea3e-4c18-9a6a-7e10efdeea2c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:12.675178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32847-ea3e-4c18-9a6a-7e10efdeea2c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:12.676518 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 659/1329] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:12.682014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ec8f-ceac-49bc-baa8-543a562adc50 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:12.682485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ec8f-ceac-49bc-baa8-543a562adc50 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:12.682588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ec8f-ceac-49bc-baa8-543a562adc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:12.758222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ba51ec8f-ceac-49bc-baa8-543a562adc50 None None] MFA Rules not processed for user `bf533d414187425ea006e350f6b6f292`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:12.759466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ba51ec8f-ceac-49bc-baa8-543a562adc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:12.868645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 671/1330] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:13.151098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32847-ea3e-4c18-9a6a-7e10efdeea2c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:13.152748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2bf32847-ea3e-4c18-9a6a-7e10efdeea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:13.190014 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:13.296686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32847-ea3e-4c18-9a6a-7e10efdeea2c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:13.394962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:13.395593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:13.395877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:13.396177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:13.397849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:13.492883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:13.534142 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:13.535586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d5ab-9409-4093-9b88-7239755e2750 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:13.560341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 660/1331] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:13 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:16.145652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993555-a66f-4e3b-8783-479b28a9834d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:16.146205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993555-a66f-4e3b-8783-479b28a9834d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:16.146205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993555-a66f-4e3b-8783-479b28a9834d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:16.147574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 672/1332] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:16.152918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493c44-17f9-443a-8014-e66c4401c960 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:16.153367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493c44-17f9-443a-8014-e66c4401c960 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:16.153470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493c44-17f9-443a-8014-e66c4401c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:16.221455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d4493c44-17f9-443a-8014-e66c4401c960 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:16.222770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d4493c44-17f9-443a-8014-e66c4401c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:16.320902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 661/1333] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:16.607378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0993555-a66f-4e3b-8783-479b28a9834d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:16.609373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e0993555-a66f-4e3b-8783-479b28a9834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:16.681958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:16.717988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0993555-a66f-4e3b-8783-479b28a9834d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:16.796969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:16.797578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:16.797858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:16.798127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:16.799781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:16.915564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:16.916974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2e9a7-f482-47a4-be50-4a6d79dad523 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:16.928033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:16.936714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 673/1334] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:19.143791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76521c16-59e2-4fba-bab6-1fcbebe3257e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:19.144376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76521c16-59e2-4fba-bab6-1fcbebe3257e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:19.144376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76521c16-59e2-4fba-bab6-1fcbebe3257e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:19.145815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 662/1335] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:19.151939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b117e-99a3-4095-9391-1f80f42e0287 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:19.152506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b117e-99a3-4095-9391-1f80f42e0287 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:19.152679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b117e-99a3-4095-9391-1f80f42e0287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:19.225223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ee8b117e-99a3-4095-9391-1f80f42e0287 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:19.226461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ee8b117e-99a3-4095-9391-1f80f42e0287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:19.343881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 674/1336] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:19.634405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76521c16-59e2-4fba-bab6-1fcbebe3257e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:19.635933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-76521c16-59e2-4fba-bab6-1fcbebe3257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:19.679517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:19.754223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76521c16-59e2-4fba-bab6-1fcbebe3257e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:19.837819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:19.838493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:19.838775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:19.839051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:19.840791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:19.935266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:19.965723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:19.967917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6ebf-6c0e-44e3-9028-45ecbe98eae3 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:19.990360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 663/1337] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:22.863854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8dbae-dc07-4f72-b912-66cadfb19dde None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:22.864551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8dbae-dc07-4f72-b912-66cadfb19dde None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:22.864551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8dbae-dc07-4f72-b912-66cadfb19dde None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:22.865837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 675/1338] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:22.871861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe23aa-624b-4bae-90ef-a37271f5d144 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:22.872446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe23aa-624b-4bae-90ef-a37271f5d144 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:22.872446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe23aa-624b-4bae-90ef-a37271f5d144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:22.947190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9dbe23aa-624b-4bae-90ef-a37271f5d144 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:22.948456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9dbe23aa-624b-4bae-90ef-a37271f5d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:23.048309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 664/1339] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:23.337189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8dbae-dc07-4f72-b912-66cadfb19dde None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:23.338735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4af8dbae-dc07-4f72-b912-66cadfb19dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:23.420565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:23.447536 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8dbae-dc07-4f72-b912-66cadfb19dde None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:23.525595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:23.526199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:23.526474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:23.526744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:23.528407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:23.648622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:23.650117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6e7b-f364-4761-979d-77f835723c9f service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:23.668397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 676/1340] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:28.180883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1ff7-74b0-4773-aac6-d1690d0503ba None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:28.181484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1ff7-74b0-4773-aac6-d1690d0503ba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:28.181484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1ff7-74b0-4773-aac6-d1690d0503ba None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:28.182792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 665/1341] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:28.189103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8696d-df20-415a-91d4-13e3a7979c8f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:28.189627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8696d-df20-415a-91d4-13e3a7979c8f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:28.189775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8696d-df20-415a-91d4-13e3a7979c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:28.195151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:28.259277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b7f8696d-df20-415a-91d4-13e3a7979c8f None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:28.260556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b7f8696d-df20-415a-91d4-13e3a7979c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:28.365929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 677/1342] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:28.651034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1ff7-74b0-4773-aac6-d1690d0503ba None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:28.652590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2e5b1ff7-74b0-4773-aac6-d1690d0503ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:28.703200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:28.768806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1ff7-74b0-4773-aac6-d1690d0503ba None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:28.851201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:28.851822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:28.852197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:28.852481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:28.854092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:28.969145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:28.985676 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:28.987214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af6caf-f854-44b5-bacc-7587cc0457e0 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:29.005218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 666/1343] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:28 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:32.106747 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7478f9-8d67-4b6b-8817-211665698a5d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:32.107301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7478f9-8d67-4b6b-8817-211665698a5d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:32.107301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7478f9-8d67-4b6b-8817-211665698a5d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:32.109807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 678/1344] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:57:32.115564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be03e-60b2-4ec5-9e2f-17ec86ffe26a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:32.116084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be03e-60b2-4ec5-9e2f-17ec86ffe26a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:32.116204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be03e-60b2-4ec5-9e2f-17ec86ffe26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:32.190345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8e5be03e-60b2-4ec5-9e2f-17ec86ffe26a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:32.191582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8e5be03e-60b2-4ec5-9e2f-17ec86ffe26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:32.300691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 667/1345] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:32.595864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7478f9-8d67-4b6b-8817-211665698a5d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:32.597690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7c7478f9-8d67-4b6b-8817-211665698a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:32.702661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:32.723113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7478f9-8d67-4b6b-8817-211665698a5d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:32.811614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:32.812245 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:32.823030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:32.823030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:32.823030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:32.937076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:32.938243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f01e9-65e8-4553-83e9-272eedf27746 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:32.956818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 679/1346] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:37.611497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97757a23-1486-4aa8-b744-2026f03d1369 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:37.611993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97757a23-1486-4aa8-b744-2026f03d1369 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:37.612092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97757a23-1486-4aa8-b744-2026f03d1369 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:37.613875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 668/1347] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:57:37.619141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb049-7e79-422d-b33f-540c9adb1557 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:37.619666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb049-7e79-422d-b33f-540c9adb1557 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:37.619666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb049-7e79-422d-b33f-540c9adb1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:37.636466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:37.694997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-532fb049-7e79-422d-b33f-540c9adb1557 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:37.696125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-532fb049-7e79-422d-b33f-540c9adb1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:37.817044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 680/1348] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:38.124866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97757a23-1486-4aa8-b744-2026f03d1369 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:38.126370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-97757a23-1486-4aa8-b744-2026f03d1369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:38.189931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:38.240816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97757a23-1486-4aa8-b744-2026f03d1369 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:38.319172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:38.319829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:38.320107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:38.320415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:38.322034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:38.430185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:38.433624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:38.435068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8c429-50ff-4d78-a27a-f00f93f47423 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:38.453698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 669/1349] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:38 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:43.665432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fa16-d634-4b14-b53e-b916ec84d8bf None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:43.665964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fa16-d634-4b14-b53e-b916ec84d8bf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:43.665964 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fa16-d634-4b14-b53e-b916ec84d8bf None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:43.667590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 681/1350] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 00:57:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:43.675652 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1520461-994f-4c91-879a-509aa491539a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:43.676130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1520461-994f-4c91-879a-509aa491539a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:43.676273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1520461-994f-4c91-879a-509aa491539a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:43.783690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e1520461-994f-4c91-879a-509aa491539a None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:43.787238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e1520461-994f-4c91-879a-509aa491539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:43.918867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 670/1351] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:47.815164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=59 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:48.418120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd1828-da25-4c28-aa97-80c606583c6b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:48.418691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd1828-da25-4c28-aa97-80c606583c6b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:48.419146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd1828-da25-4c28-aa97-80c606583c6b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:48.420745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 682/1352] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 00:57:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:48.426951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e14e39-8097-4c32-9661-160c9e57d5a7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:48.427445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e14e39-8097-4c32-9661-160c9e57d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:48.427606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e14e39-8097-4c32-9661-160c9e57d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:48.490858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:48.516576 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-66e14e39-8097-4c32-9661-160c9e57d5a7 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:48.523336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-66e14e39-8097-4c32-9661-160c9e57d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:48.646645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 671/1353] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:50.050888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd827c-f923-4d36-8fbd-9f01d6acf4cb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:50.051400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd827c-f923-4d36-8fbd-9f01d6acf4cb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:50.051400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd827c-f923-4d36-8fbd-9f01d6acf4cb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:50.052736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 683/1354] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 00:57:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:50.058346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1203d-cc09-47b4-bac7-d1a403966b78 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:50.058826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1203d-cc09-47b4-bac7-d1a403966b78 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:50.058826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1203d-cc09-47b4-bac7-d1a403966b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:50.145390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d5e1203d-cc09-47b4-bac7-d1a403966b78 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:50.146625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d5e1203d-cc09-47b4-bac7-d1a403966b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:50.191458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:50.262517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 672/1355] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:57:53.758207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232261d-8962-434a-abca-960bb901d124 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:53.759175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232261d-8962-434a-abca-960bb901d124 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:53.759550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232261d-8962-434a-abca-960bb901d124 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:53.761136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 684/1356] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:57:53.767188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a641-88d6-4ea7-acfe-c8300de4fb74 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:53.767646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a641-88d6-4ea7-acfe-c8300de4fb74 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:53.767741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a641-88d6-4ea7-acfe-c8300de4fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:53.861855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b413a641-88d6-4ea7-acfe-c8300de4fb74 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:53.861855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b413a641-88d6-4ea7-acfe-c8300de4fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:54.009222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 673/1357] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:54.363475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db880-4a78-4c8f-a6ea-13d817d06db5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:54.364353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db880-4a78-4c8f-a6ea-13d817d06db5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:54.365026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db880-4a78-4c8f-a6ea-13d817d06db5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:54.367417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 685/1358] 10.222.0.122 () {54 vars in 967 bytes} [Fri Aug 26 00:57:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:57:54.377710 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e954f7-8644-434c-9c9a-3fe980e8ff88 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:54.378517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e954f7-8644-434c-9c9a-3fe980e8ff88 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:54.379035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e954f7-8644-434c-9c9a-3fe980e8ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:54.399797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:54.476675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-24e954f7-8644-434c-9c9a-3fe980e8ff88 None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:54.478006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-24e954f7-8644-434c-9c9a-3fe980e8ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:54.624635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 674/1359] 10.222.0.122 () {58 vars in 1064 bytes} [Fri Aug 26 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:54.633076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558db880-4a78-4c8f-a6ea-13d817d06db5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:54.634883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-558db880-4a78-4c8f-a6ea-13d817d06db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:54.798574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558db880-4a78-4c8f-a6ea-13d817d06db5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:54.882782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:54.928106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:54.928929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:54.929143 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:54.929376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:54.930986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:55.034076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:55.036033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e660e4-daa9-4be2-b916-8497d3637b73 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:55.055473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 686/1360] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:57.258745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471730-370f-46c0-a625-c71caead7113 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:57.259270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471730-370f-46c0-a625-c71caead7113 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:57.259270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471730-370f-46c0-a625-c71caead7113 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:57.260584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 675/1361] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:57:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:57:57.266822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bbcb-9e88-4281-8fdf-819720775729 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:57.267328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bbcb-9e88-4281-8fdf-819720775729 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:57.267434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87bbcb-9e88-4281-8fdf-819720775729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:57.349930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cc87bbcb-9e88-4281-8fdf-819720775729 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:57.351210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cc87bbcb-9e88-4281-8fdf-819720775729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:57.400971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:57.484848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 687/1362] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:57.782354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22471730-370f-46c0-a625-c71caead7113 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:57.788435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-22471730-370f-46c0-a625-c71caead7113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:57.857898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:57.947082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22471730-370f-46c0-a625-c71caead7113 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:58.074732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:58.075348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:58.075630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:58.075902 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:58.077837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:58.112010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:58.191470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:58.193417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ab5fa-2c01-449b-954f-c59df2571eb9 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:58.216752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 676/1363] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:57:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:00.672894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e83cb4-f7f7-451e-8724-841c474ef821 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:00.673566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e83cb4-f7f7-451e-8724-841c474ef821 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:00.673566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e83cb4-f7f7-451e-8724-841c474ef821 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:00.674777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 688/1364] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:00.680565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401338-6dc0-48af-90ec-1a8a7cb74606 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:00.681035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401338-6dc0-48af-90ec-1a8a7cb74606 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:00.681132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401338-6dc0-48af-90ec-1a8a7cb74606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:00.758313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-01401338-6dc0-48af-90ec-1a8a7cb74606 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:00.759436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-01401338-6dc0-48af-90ec-1a8a7cb74606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:00.867484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:00.872205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 677/1365] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:00 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:01.169639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f401f-e761-4dfe-9b77-6f99638d5b81 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:01.170220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f401f-e761-4dfe-9b77-6f99638d5b81 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:01.170673 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f401f-e761-4dfe-9b77-6f99638d5b81 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:01.173535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 689/1366] 10.222.0.122 () {54 vars in 967 bytes} [Fri Aug 26 00:58:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:01.179326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383878-59b3-4af3-8cfa-427a3574ff89 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:01.179712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383878-59b3-4af3-8cfa-427a3574ff89 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:01.180086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383878-59b3-4af3-8cfa-427a3574ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:01.271303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7d383878-59b3-4af3-8cfa-427a3574ff89 None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:01.272557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d383878-59b3-4af3-8cfa-427a3574ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:01.420217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 678/1367] 10.222.0.122 () {58 vars in 1064 bytes} [Fri Aug 26 00:58:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:01.429580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f401f-e761-4dfe-9b77-6f99638d5b81 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:01.431447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fd1f401f-e761-4dfe-9b77-6f99638d5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:01.608574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f401f-e761-4dfe-9b77-6f99638d5b81 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:01.632357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:01.747483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:01.748261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:01.748645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:01.749020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:01.751254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:01.851679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:01.853610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03774c36-cf21-4874-b03b-d78bd3f01ba4 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:01.875384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 690/1368] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:02.289424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7cb04-1881-4d2b-90b9-5640626db7f6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:02.290112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7cb04-1881-4d2b-90b9-5640626db7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:02.290112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7cb04-1881-4d2b-90b9-5640626db7f6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:02.292265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 679/1369] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:02.298122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f913d-e9c7-434e-a477-da94b2cf5b62 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:02.298368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f913d-e9c7-434e-a477-da94b2cf5b62 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:02.298464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f913d-e9c7-434e-a477-da94b2cf5b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:02.335706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:02.377347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-965f913d-e9c7-434e-a477-da94b2cf5b62 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:02.379108 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-965f913d-e9c7-434e-a477-da94b2cf5b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:02.497337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 691/1370] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:03.093127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8901a4-f86d-4968-9487-cea07933df3b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:03.093127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8901a4-f86d-4968-9487-cea07933df3b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:03.093127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8901a4-f86d-4968-9487-cea07933df3b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:03.094104 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 680/1371] 10.222.0.122 () {54 vars in 969 bytes} [Fri Aug 26 00:58:03 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:03.099562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ebe6e-566b-43e8-aee6-91f9357a11f2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:03.100299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ebe6e-566b-43e8-aee6-91f9357a11f2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:03.100299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ebe6e-566b-43e8-aee6-91f9357a11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:03.186269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1e8ebe6e-566b-43e8-aee6-91f9357a11f2 None None] MFA Rules not processed for user `e77f464caecc4799b2c310ea640a3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:03.188884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1e8ebe6e-566b-43e8-aee6-91f9357a11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:03.246395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:03.305958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 692/1372] 10.222.0.122 () {58 vars in 1066 bytes} [Fri Aug 26 00:58:03 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:03.315268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8901a4-f86d-4968-9487-cea07933df3b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:03.316813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3d8901a4-f86d-4968-9487-cea07933df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:03.375729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:03.436355 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8901a4-f86d-4968-9487-cea07933df3b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:03.519478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77f464caecc4799b2c310ea640a3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:03.520087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:03.520415 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:03.520706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:03.522335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:03.630802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:03.649392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:03.650675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9970-2735-456f-9384-7efc54570ab9 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:03.670072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 681/1373] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:04.110107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b279a-5d2e-4dac-bf4e-5ec37076b293 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:04.110787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b279a-5d2e-4dac-bf4e-5ec37076b293 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:04.110787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b279a-5d2e-4dac-bf4e-5ec37076b293 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:04.111941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 693/1374] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:04.117827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80717d1-9650-4c37-895e-90fb52bb3c9e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:04.118206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80717d1-9650-4c37-895e-90fb52bb3c9e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:04.118490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80717d1-9650-4c37-895e-90fb52bb3c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:04.192829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a80717d1-9650-4c37-895e-90fb52bb3c9e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:04.194648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a80717d1-9650-4c37-895e-90fb52bb3c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:04.310046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 682/1375] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:04.606230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b279a-5d2e-4dac-bf4e-5ec37076b293 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:04.607786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-023b279a-5d2e-4dac-bf4e-5ec37076b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:04.766483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b279a-5d2e-4dac-bf4e-5ec37076b293 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:04.823478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:04.891559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:04.892507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:04.892790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:04.893063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:04.894735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:04.990788 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:04.992716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788d86c-9ebe-403d-b507-e3c600fa0352 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:05.012030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 694/1376] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:04 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:07.162761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30237-904a-475b-ab16-a3611f0fe742 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:07.163390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30237-904a-475b-ab16-a3611f0fe742 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:07.163390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30237-904a-475b-ab16-a3611f0fe742 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:07.164706 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 683/1377] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:07.170690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38767181-ee5f-4d56-ab96-795e2c2921c8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:07.171213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38767181-ee5f-4d56-ab96-795e2c2921c8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:07.171380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38767181-ee5f-4d56-ab96-795e2c2921c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:07.242621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-38767181-ee5f-4d56-ab96-795e2c2921c8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:07.243830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-38767181-ee5f-4d56-ab96-795e2c2921c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:07.251600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:07.355041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 695/1378] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:07.664971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30237-904a-475b-ab16-a3611f0fe742 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:07.666773 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-43c30237-904a-475b-ab16-a3611f0fe742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:07.743437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:07.848606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30237-904a-475b-ab16-a3611f0fe742 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:07.991294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:07.991948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:07.992292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:07.992684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:07.995913 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:08.020433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:08.112779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:08.114522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dec3e-5a49-4e2d-a7c1-82644a0d0640 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:08.136467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 684/1379] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:10.296227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc95baa-7579-4cdf-862b-3a51f7a7134b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:10.296887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc95baa-7579-4cdf-862b-3a51f7a7134b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:10.297110 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc95baa-7579-4cdf-862b-3a51f7a7134b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:10.298696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 696/1380] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:10.304827 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c0f9-cd5c-4738-a75e-e5ec8e42fc08 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:10.305705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c0f9-cd5c-4738-a75e-e5ec8e42fc08 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:10.305705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c0f9-cd5c-4738-a75e-e5ec8e42fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:10.379655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5c50c0f9-cd5c-4738-a75e-e5ec8e42fc08 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:10.382553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5c50c0f9-cd5c-4738-a75e-e5ec8e42fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:10.498394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:10.520186 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 685/1381] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:10.805214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc95baa-7579-4cdf-862b-3a51f7a7134b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:10.806813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4cc95baa-7579-4cdf-862b-3a51f7a7134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:10.971908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:10.983322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc95baa-7579-4cdf-862b-3a51f7a7134b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:11.135694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:11.136345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:11.136620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:11.136884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:11.138557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:11.243057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:11.244746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825efcdb-de15-40c7-97ae-400e39f47a23 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:11.256752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:11.266149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 697/1382] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:10 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:13.426282 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd996-6232-4710-bd7e-1a4a53c59db8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:13.426830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd996-6232-4710-bd7e-1a4a53c59db8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:13.427319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd996-6232-4710-bd7e-1a4a53c59db8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:13.429599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 686/1383] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:13.434968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c37c6-5908-4ea8-a885-969d81ee3cf0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:13.435451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c37c6-5908-4ea8-a885-969d81ee3cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:13.435546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c37c6-5908-4ea8-a885-969d81ee3cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:13.512358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-898c37c6-5908-4ea8-a885-969d81ee3cf0 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:13.513636 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-898c37c6-5908-4ea8-a885-969d81ee3cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:13.616273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 698/1384] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:13.911657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dd996-6232-4710-bd7e-1a4a53c59db8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:13.914351 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-280dd996-6232-4710-bd7e-1a4a53c59db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:14.082672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dd996-6232-4710-bd7e-1a4a53c59db8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:14.159154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:14.209787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:14.210404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:14.210732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:14.210970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:14.212846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:14.318377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:14.320360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9aef-b6f5-4b97-afee-055ce8b2a0dd service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:14.345130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 687/1385] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:16.856191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61223d6c-4e38-443e-a5d2-5103525a8713 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:16.856753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61223d6c-4e38-443e-a5d2-5103525a8713 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:16.856946 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61223d6c-4e38-443e-a5d2-5103525a8713 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:16.858866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 699/1386] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:16.866394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b1e2-2660-455d-a46f-2905a93e3fe0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:16.867079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b1e2-2660-455d-a46f-2905a93e3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:16.867079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b1e2-2660-455d-a46f-2905a93e3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:16.942645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b053b1e2-2660-455d-a46f-2905a93e3fe0 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:16.943866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b053b1e2-2660-455d-a46f-2905a93e3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:16.978998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:17.049932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 688/1387] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:17.349352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61223d6c-4e38-443e-a5d2-5103525a8713 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:17.351304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-61223d6c-4e38-443e-a5d2-5103525a8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:17.458801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:17.536940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61223d6c-4e38-443e-a5d2-5103525a8713 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:17.677071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:17.677597 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:17.677875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:17.678146 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:17.679751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:17.724016 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:17.778916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:17.780624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b5858-c30e-4077-994b-8577ba9ceb70 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:17.800635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 700/1388] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:17 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:19.636499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe32f-5647-4fc1-9347-8dd78e1ce4a2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:19.637023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe32f-5647-4fc1-9347-8dd78e1ce4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:19.637023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe32f-5647-4fc1-9347-8dd78e1ce4a2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:19.638270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 689/1389] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:19.644479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5b71-16af-4b88-a350-9e0ac10156fd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:19.644976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5b71-16af-4b88-a350-9e0ac10156fd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:19.645164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5b71-16af-4b88-a350-9e0ac10156fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:19.716648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-636f5b71-16af-4b88-a350-9e0ac10156fd None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:19.717866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-636f5b71-16af-4b88-a350-9e0ac10156fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:19.832335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 701/1390] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:20.140019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589af3-eec4-44b8-9f1c-224faa9e47ed None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:20.140331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589af3-eec4-44b8-9f1c-224faa9e47ed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:20.140626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589af3-eec4-44b8-9f1c-224faa9e47ed None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:20.142429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 690/1391] 10.222.0.122 () {54 vars in 972 bytes} [Fri Aug 26 00:58:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:20.147746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17480-9abb-4974-88df-13a4c627f26e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:20.148028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17480-9abb-4974-88df-13a4c627f26e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:20.148329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17480-9abb-4974-88df-13a4c627f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:20.164974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:20.233080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0eb17480-9abb-4974-88df-13a4c627f26e None None] MFA Rules not processed for user `db0844a1faa142d2a469fe561e4b72ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:20.234286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0eb17480-9abb-4974-88df-13a4c627f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:20.322311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 702/1392] 10.222.0.122 () {58 vars in 1069 bytes} [Fri Aug 26 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:20.330330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5589af3-eec4-44b8-9f1c-224faa9e47ed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:20.331822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b5589af3-eec4-44b8-9f1c-224faa9e47ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:20.362115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62b2a-a499-4d73-84e5-61a142627f73 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:20.362880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62b2a-a499-4d73-84e5-61a142627f73 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:20.362880 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb62b2a-a499-4d73-84e5-61a142627f73 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:20.364440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 703/1393] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:58:20.370888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:20.370888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:20.371087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:20.447471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5589af3-eec4-44b8-9f1c-224faa9e47ed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:20.449081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:20.450364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:20.510058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:20.511404 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:20.528802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db0844a1faa142d2a469fe561e4b72ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:20.529522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:20.529682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:20.529956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:20.532107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:20.557011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 704/1394] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:20.653380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:20.654821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3e12-9bef-45a6-b7d2-3a6721d10165 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:20.675145 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 691/1395] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:20.858561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:20.860394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:20.995881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca8e51-1532-4cfa-a236-1a035bbd6d0a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:21.067823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:21.128511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:21.129307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:21.129604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:21.129992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:21.135684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:21.245842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:21.247553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bc775-de58-4307-91f5-8582934cb74d service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:21.267152 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 705/1396] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:21.640238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c7c4-9a19-402a-ad39-a73c73aee3fa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:21.640527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c7c4-9a19-402a-ad39-a73c73aee3fa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:21.640797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c7c4-9a19-402a-ad39-a73c73aee3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:21.721305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7bb8c7c4-9a19-402a-ad39-a73c73aee3fa None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:21.722648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7bb8c7c4-9a19-402a-ad39-a73c73aee3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:21.766672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:21.814280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 692/1397] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 00:58:21 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:21.859850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b7aa4-b06a-4acc-a0c1-c1fb65bc77bf None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:21.860469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b7aa4-b06a-4acc-a0c1-c1fb65bc77bf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:21.860469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b7aa4-b06a-4acc-a0c1-c1fb65bc77bf None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:21.861822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 706/1398] 10.222.0.122 () {54 vars in 948 bytes} [Fri Aug 26 00:58:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:21.868979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca065e2c-9b95-492c-9e83-9334c13c564e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:21.869268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca065e2c-9b95-492c-9e83-9334c13c564e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:21.869542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca065e2c-9b95-492c-9e83-9334c13c564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:21.951583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ca065e2c-9b95-492c-9e83-9334c13c564e None None] MFA Rules not processed for user `42193a1473a0485787f60b5bd963e7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:21.952809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ca065e2c-9b95-492c-9e83-9334c13c564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:22.068408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 693/1399] 10.222.0.122 () {58 vars in 1045 bytes} [Fri Aug 26 00:58:21 2022] POST /identity/v3/auth/tokens => generated 3314 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:22.082342 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b7aa4-b06a-4acc-a0c1-c1fb65bc77bf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:22.083908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a7b7aa4-b06a-4acc-a0c1-c1fb65bc77bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:22.174009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:22.236441 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b7aa4-b06a-4acc-a0c1-c1fb65bc77bf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:22.349798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:22.350411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:22.350795 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:22.351065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:22.352733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:22.421372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:22.441505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:22.443096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e82c-71ef-46c4-bb15-a7b0bc04431d service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:22.451777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 707/1400] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 00:58:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:58:23.373840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f28b8-d57e-40aa-a41c-7e6c57308ad6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:23.374305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f28b8-d57e-40aa-a41c-7e6c57308ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:23.374408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f28b8-d57e-40aa-a41c-7e6c57308ad6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:23.376575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 694/1401] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:23.382359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb75aa-7484-4d88-a48a-aa0d095138e9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:23.382865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb75aa-7484-4d88-a48a-aa0d095138e9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:23.382952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb75aa-7484-4d88-a48a-aa0d095138e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:23.472358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-edfb75aa-7484-4d88-a48a-aa0d095138e9 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:23.475171 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-edfb75aa-7484-4d88-a48a-aa0d095138e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:23.609002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 708/1402] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:23.909989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f28b8-d57e-40aa-a41c-7e6c57308ad6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:23.922630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a89f28b8-d57e-40aa-a41c-7e6c57308ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:23.927456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:24.082054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f28b8-d57e-40aa-a41c-7e6c57308ad6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:24.193787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:24.223499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:24.224199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:24.224842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:24.224842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:24.226363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:24.339891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:24.341792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02152cac-cf9c-4bcb-9d53-eb3e5df3a9d7 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:24.367381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 695/1403] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:27.221593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ac9f-1ec0-4ffb-b9b9-dee75edda52a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.222199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ac9f-1ec0-4ffb-b9b9-dee75edda52a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.222199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ac9f-1ec0-4ffb-b9b9-dee75edda52a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.223503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 709/1404] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:58:27.229133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac3097-e061-4054-845f-b83bef219f42 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.229608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac3097-e061-4054-845f-b83bef219f42 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.229703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac3097-e061-4054-845f-b83bef219f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.306823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c5ac3097-e061-4054-845f-b83bef219f42 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:27.308058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c5ac3097-e061-4054-845f-b83bef219f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:27.369951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:27.421786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 696/1405] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:27.722045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ac9f-1ec0-4ffb-b9b9-dee75edda52a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.723631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d056ac9f-1ec0-4ffb-b9b9-dee75edda52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:27.809018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:27.911845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ac9f-1ec0-4ffb-b9b9-dee75edda52a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:28.065549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:28.066173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:28.066452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:28.066726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:28.068746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:28.095093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:28.193370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:28.195393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ebc4d-7857-4f22-ae8d-963a9698f897 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:28.220469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 710/1406] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:30.600426 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e2ccd-7dbb-4ad0-a36c-6ea6d80de6ab None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:30.601024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e2ccd-7dbb-4ad0-a36c-6ea6d80de6ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:30.601024 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e2ccd-7dbb-4ad0-a36c-6ea6d80de6ab None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:30.602304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 697/1407] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:58:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:30.608174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159c24-ba6c-444d-a798-9193a27a58d2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:30.608721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159c24-ba6c-444d-a798-9193a27a58d2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:30.608721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159c24-ba6c-444d-a798-9193a27a58d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:30.690927 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5d159c24-ba6c-444d-a798-9193a27a58d2 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:30.692214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5d159c24-ba6c-444d-a798-9193a27a58d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:30.815701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:30.822310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 711/1408] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:31.122868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e2ccd-7dbb-4ad0-a36c-6ea6d80de6ab None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:31.124461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-498e2ccd-7dbb-4ad0-a36c-6ea6d80de6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:31.322059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e2ccd-7dbb-4ad0-a36c-6ea6d80de6ab None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:31.368092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:31.480883 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:31.481516 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:31.481797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:31.482070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:31.484364 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:31.601307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:31.602919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4baad-f879-4a06-8f76-85cb5e6cca30 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:31.625657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 698/1409] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:40.855409 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:41.622696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=83 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:46.694541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd968d-5d41-47e7-8b60-472bbed822e9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:46.695267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd968d-5d41-47e7-8b60-472bbed822e9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:46.695267 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd968d-5d41-47e7-8b60-472bbed822e9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:46.696481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 712/1410] 10.222.0.122 () {54 vars in 923 bytes} [Fri Aug 26 00:58:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:46.701864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69ef8-bb92-4692-9612-acca5e4ee9b4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:46.702403 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69ef8-bb92-4692-9612-acca5e4ee9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:46.702507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69ef8-bb92-4692-9612-acca5e4ee9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:46.784368 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-26e69ef8-bb92-4692-9612-acca5e4ee9b4 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:46.785647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-26e69ef8-bb92-4692-9612-acca5e4ee9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:46.902398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 699/1411] 10.222.0.122 () {58 vars in 1020 bytes} [Fri Aug 26 00:58:46 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:46.918071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27113-c76c-428f-8a41-0d2eeff1054d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:46.918354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27113-c76c-428f-8a41-0d2eeff1054d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:46.918625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27113-c76c-428f-8a41-0d2eeff1054d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:46.920039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 713/1412] 10.222.0.122 () {54 vars in 923 bytes} [Fri Aug 26 00:58:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:46.925298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21720-a9dd-47c0-b377-31710ea9b6ab None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:46.925582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21720-a9dd-47c0-b377-31710ea9b6ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:46.925857 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21720-a9dd-47c0-b377-31710ea9b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:47.003039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:47.006219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-96b21720-a9dd-47c0-b377-31710ea9b6ab None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:47.007430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-96b21720-a9dd-47c0-b377-31710ea9b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:47.134858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 700/1413] 10.222.0.122 () {58 vars in 1020 bytes} [Fri Aug 26 00:58:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:49.727154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677883d-e110-4f60-8182-4985e75b553a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:49.727742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677883d-e110-4f60-8182-4985e75b553a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:49.727742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677883d-e110-4f60-8182-4985e75b553a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:49.729087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:58:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:49.735356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4943-0fdd-4e7c-a5ac-f55edeac885c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:49.735846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4943-0fdd-4e7c-a5ac-f55edeac885c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:49.735961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4943-0fdd-4e7c-a5ac-f55edeac885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:49.808561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-05cf4943-0fdd-4e7c-a5ac-f55edeac885c None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:49.809789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-05cf4943-0fdd-4e7c-a5ac-f55edeac885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:49.882855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:49.928695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:50.225436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677883d-e110-4f60-8182-4985e75b553a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:50.227055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c677883d-e110-4f60-8182-4985e75b553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:50.404120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677883d-e110-4f60-8182-4985e75b553a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:50.485897 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:50.531612 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:50.531936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:50.532241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:50.532513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:50.534629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:50.631637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:50.633283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c416a3-7406-4841-97e4-1835d687946f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:50.652838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 715/1416] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:51.578294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc8c9f-bcd8-4b94-8cb7-cbc155a62e9a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:51.585019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc8c9f-bcd8-4b94-8cb7-cbc155a62e9a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:51.585019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc8c9f-bcd8-4b94-8cb7-cbc155a62e9a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:51.585019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:58:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:51.586951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad489744-ef16-402b-8d7a-e5bda4cc0ee4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:51.587392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad489744-ef16-402b-8d7a-e5bda4cc0ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:51.587503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad489744-ef16-402b-8d7a-e5bda4cc0ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:51.668392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ad489744-ef16-402b-8d7a-e5bda4cc0ee4 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:51.669546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ad489744-ef16-402b-8d7a-e5bda4cc0ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:51.699262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:51.772003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:58:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:51.924462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc8c9f-bcd8-4b94-8cb7-cbc155a62e9a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:51.925864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c1dc8c9f-bcd8-4b94-8cb7-cbc155a62e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:52.077164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc8c9f-bcd8-4b94-8cb7-cbc155a62e9a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:52.121067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:52.199281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c4617-747b-4801-8081-795746ac265a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:52.199796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c4617-747b-4801-8081-795746ac265a service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:52.200075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c4617-747b-4801-8081-795746ac265a service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:52.200374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c4617-747b-4801-8081-795746ac265a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:52.201956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-906c4617-747b-4801-8081-795746ac265a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:52.299469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c4617-747b-4801-8081-795746ac265a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:52.301481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c4617-747b-4801-8081-795746ac265a service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:52.320126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 703/1419] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:53.233870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7365a-3560-46ca-b7c6-88582689336f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:53.235285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7365a-3560-46ca-b7c6-88582689336f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:53.235285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7365a-3560-46ca-b7c6-88582689336f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:53.235762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:58:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:53.241189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb236a9-e9d4-4dbe-8c9b-c16e311713db None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:53.241648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb236a9-e9d4-4dbe-8c9b-c16e311713db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:53.241760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb236a9-e9d4-4dbe-8c9b-c16e311713db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:53.299106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:53.322433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6bb236a9-e9d4-4dbe-8c9b-c16e311713db None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:53.323686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6bb236a9-e9d4-4dbe-8c9b-c16e311713db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:53.427660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:58:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:53.581763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7365a-3560-46ca-b7c6-88582689336f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:53.583369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a9e7365a-3560-46ca-b7c6-88582689336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:53.743101 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7365a-3560-46ca-b7c6-88582689336f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:53.756461 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:53.867343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:53.868147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:53.868689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:53.869161 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:53.871941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:53.970507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:53.972112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7dbe3-bf03-462c-996b-69aae0ef74d0 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:53.990357 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 718/1422] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:54.868844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ee5c1-52a6-4f0c-9ccb-038f50cd3c68 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:54.869435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ee5c1-52a6-4f0c-9ccb-038f50cd3c68 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:54.869435 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ee5c1-52a6-4f0c-9ccb-038f50cd3c68 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:54.870781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:58:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:54.875641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468454be-8f86-4b91-8544-6c32da5d5d32 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:54.876064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468454be-8f86-4b91-8544-6c32da5d5d32 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:54.876192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468454be-8f86-4b91-8544-6c32da5d5d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:54.897114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:54.955623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-468454be-8f86-4b91-8544-6c32da5d5d32 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:54.956777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-468454be-8f86-4b91-8544-6c32da5d5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:55.059802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:58:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:55.217401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ee5c1-52a6-4f0c-9ccb-038f50cd3c68 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:55.218817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f50ee5c1-52a6-4f0c-9ccb-038f50cd3c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:55.333013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:55.371448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ee5c1-52a6-4f0c-9ccb-038f50cd3c68 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:55.501191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:55.502328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:55.502596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:55.502873 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:55.504514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:55.584333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:55.599473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:55.601126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89bd74-6070-4e5c-b217-0e29e6164fea service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:55.620176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 706/1425] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:56.532015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2275262-3be7-4674-b077-0c3f9e5fc9de None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.532728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2275262-3be7-4674-b077-0c3f9e5fc9de None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.532728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2275262-3be7-4674-b077-0c3f9e5fc9de None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.534070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:58:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:56.539087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bddab-87d5-4530-ae60-bdcb5b7c9a88 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.539546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bddab-87d5-4530-ae60-bdcb5b7c9a88 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.539657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bddab-87d5-4530-ae60-bdcb5b7c9a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.618215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-458bddab-87d5-4530-ae60-bdcb5b7c9a88 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:56.619428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-458bddab-87d5-4530-ae60-bdcb5b7c9a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:56.722185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:58:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:56.885926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2275262-3be7-4674-b077-0c3f9e5fc9de None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:56.887488 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f2275262-3be7-4674-b077-0c3f9e5fc9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:56.975777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:57.046491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2275262-3be7-4674-b077-0c3f9e5fc9de None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:57.164804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:57.167605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.167605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.167605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.167605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:57.217965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:57.259796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:57.261436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1578490-f306-4588-88db-6ff3cf21944e service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:57.279809 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 721/1428] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:56 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:58.179720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996981-c381-45e4-bc20-aacf34cdd4f8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:58.180373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996981-c381-45e4-bc20-aacf34cdd4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:58.180373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996981-c381-45e4-bc20-aacf34cdd4f8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:58.181623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:58:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:58.186849 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc326-f440-46d9-aef6-0ec0e49e019e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:58.187323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc326-f440-46d9-aef6-0ec0e49e019e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:58.187428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc326-f440-46d9-aef6-0ec0e49e019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:58.270823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-95abc326-f440-46d9-aef6-0ec0e49e019e None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:58.272033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-95abc326-f440-46d9-aef6-0ec0e49e019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:58.369447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:58:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:58.521907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996981-c381-45e4-bc20-aacf34cdd4f8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:58.523478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e8996981-c381-45e4-bc20-aacf34cdd4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:58.573810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:58.671723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996981-c381-45e4-bc20-aacf34cdd4f8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:58.791957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:58.792513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:58.792791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:58.793058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:58.794654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:58.801976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:58.890064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:58.891733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a6893-471f-4a44-aca5-9052ab4d14b0 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:58.910990 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 709/1431] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:58:58 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:59.804954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa251-e201-493a-9823-2c6971cf2f38 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:59.805517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa251-e201-493a-9823-2c6971cf2f38 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:59.805517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa251-e201-493a-9823-2c6971cf2f38 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:59.806850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:58:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:58:59.811908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e61be-5985-4739-bec4-a25363ee62c5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:59.812377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e61be-5985-4739-bec4-a25363ee62c5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:59.812480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e61be-5985-4739-bec4-a25363ee62c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:59.891517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-289e61be-5985-4739-bec4-a25363ee62c5 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:59.893555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-289e61be-5985-4739-bec4-a25363ee62c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:59.963053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:59.993396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:58:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:00.149663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39aa251-e201-493a-9823-2c6971cf2f38 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:00.152123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a39aa251-e201-493a-9823-2c6971cf2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:00.171926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:00.305992 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39aa251-e201-493a-9823-2c6971cf2f38 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:00.395295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:00.419841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:00.420469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:00.420742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:00.421005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:00.422592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:00.519570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:00.521204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c03f5-7caf-44e9-a3a4-875ee9e0eeaa service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:00.539592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 724/1434] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:00 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:01.408021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfce73-cfd6-4a30-afbc-bca6b00c9012 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:01.408593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfce73-cfd6-4a30-afbc-bca6b00c9012 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:01.408793 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfce73-cfd6-4a30-afbc-bca6b00c9012 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:01.410010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:59:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:01.415051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1f6c-9142-4295-898d-00a30934f029 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:01.415510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1f6c-9142-4295-898d-00a30934f029 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:01.415614 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1f6c-9142-4295-898d-00a30934f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:01.495507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-da7b1f6c-9142-4295-898d-00a30934f029 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:01.496821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-da7b1f6c-9142-4295-898d-00a30934f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:01.540893 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:01.599123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:59:01.756499 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfce73-cfd6-4a30-afbc-bca6b00c9012 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:01.757985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-69bfce73-cfd6-4a30-afbc-bca6b00c9012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:01.904455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfce73-cfd6-4a30-afbc-bca6b00c9012 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:01.961559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:02.021780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:02.022424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:02.022647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:02.022919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:02.024540 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:02.115028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:02.116654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae17e17-8f7f-440b-814b-e0dc8d7545ee service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:02.135559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 712/1437] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:03.044322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62cae-40e7-460d-a12d-a37d68ed2f5c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:03.044848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62cae-40e7-460d-a12d-a37d68ed2f5c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:03.044848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62cae-40e7-460d-a12d-a37d68ed2f5c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:03.046135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:59:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:03.051270 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d653a5-4d93-49e0-9471-72910bb4a3a3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:03.051723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d653a5-4d93-49e0-9471-72910bb4a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:03.051825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d653a5-4d93-49e0-9471-72910bb4a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:03.139063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c8d653a5-4d93-49e0-9471-72910bb4a3a3 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:03.140340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c8d653a5-4d93-49e0-9471-72910bb4a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:03.142949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:03.241310 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:03.394781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62cae-40e7-460d-a12d-a37d68ed2f5c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:03.396375 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-95f62cae-40e7-460d-a12d-a37d68ed2f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:03.547009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62cae-40e7-460d-a12d-a37d68ed2f5c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:03.576131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:03.666105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:03.666625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:03.666903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:03.667173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:03.668881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:03.764812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:03.766456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6326e4-edd0-4d2c-8ecc-c5dc5fe8a41b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:03.784850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 727/1440] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:03 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:05.631265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a386-e347-4cd7-ba45-1596d58f40f7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:05.631833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a386-e347-4cd7-ba45-1596d58f40f7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:05.631833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a386-e347-4cd7-ba45-1596d58f40f7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:05.633189 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:05.638679 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14b546-5f99-4648-8646-edd68db49da2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:05.639156 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14b546-5f99-4648-8646-edd68db49da2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:05.639298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14b546-5f99-4648-8646-edd68db49da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:05.680687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:05.707940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5e14b546-5f99-4648-8646-edd68db49da2 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:05.709287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5e14b546-5f99-4648-8646-edd68db49da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:05.813891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:05 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:06.105366 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a386-e347-4cd7-ba45-1596d58f40f7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:06.106951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ba54a386-e347-4cd7-ba45-1596d58f40f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:06.213365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a386-e347-4cd7-ba45-1596d58f40f7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:06.247132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:06.291087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:06.291684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:06.291961 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:06.292284 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:06.293870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:06.403376 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:06.404226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae673f-128f-4a35-a94a-e53dd6602dd8 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:06.423485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 715/1443] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:06 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:08.510748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f6fca-df39-427a-9c97-c5afcfadaf34 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:08.511304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f6fca-df39-427a-9c97-c5afcfadaf34 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:08.511304 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f6fca-df39-427a-9c97-c5afcfadaf34 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:08.512667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:08.519165 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649d2ff-4d0d-4be2-aafa-9939f2cbe766 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:08.520045 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649d2ff-4d0d-4be2-aafa-9939f2cbe766 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:08.520552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649d2ff-4d0d-4be2-aafa-9939f2cbe766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:08.588937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c649d2ff-4d0d-4be2-aafa-9939f2cbe766 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:08.590154 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c649d2ff-4d0d-4be2-aafa-9939f2cbe766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:08.604448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:08.689093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:08 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:08.982022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f6fca-df39-427a-9c97-c5afcfadaf34 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:08.983555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5d7f6fca-df39-427a-9c97-c5afcfadaf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:09.097813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f6fca-df39-427a-9c97-c5afcfadaf34 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:09.113463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:09.180694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:09.181295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:09.181568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:09.181838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:09.183438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:09.294925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:09.296333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af27cc-b01f-4a63-b328-44e3609cc90f service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:09.315533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 730/1446] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:08 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:11.692654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49b79-0a47-41fc-a228-d79368d3fa8a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:11.693178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49b79-0a47-41fc-a228-d79368d3fa8a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:11.693178 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49b79-0a47-41fc-a228-d79368d3fa8a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:11.694452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:11.699894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ccee-047b-4910-88c8-0d138094dd5d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:11.700377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ccee-047b-4910-88c8-0d138094dd5d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:11.700474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ccee-047b-4910-88c8-0d138094dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:11.750390 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:11.769876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c595ccee-047b-4910-88c8-0d138094dd5d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:11.771158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c595ccee-047b-4910-88c8-0d138094dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:11.878624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:12.169223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49b79-0a47-41fc-a228-d79368d3fa8a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:12.170750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b1f49b79-0a47-41fc-a228-d79368d3fa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:12.279695 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49b79-0a47-41fc-a228-d79368d3fa8a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:12.324703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:12.358982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:12.359665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:12.359868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:12.360134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:12.361863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:12.474373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:12.475718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949350a-413f-4d3f-9cef-b630af5fd5bc service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:12.493841 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 718/1449] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:12 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:14.637236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beaf1b-5905-4cc3-996f-b4739fb6e075 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:14.638159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beaf1b-5905-4cc3-996f-b4739fb6e075 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:14.638325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beaf1b-5905-4cc3-996f-b4739fb6e075 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:14.639802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:14.646025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340fc6-f8be-4335-b40d-945a74321e50 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:14.646492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340fc6-f8be-4335-b40d-945a74321e50 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:14.646633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340fc6-f8be-4335-b40d-945a74321e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:14.714933 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-72340fc6-f8be-4335-b40d-945a74321e50 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:14.716166 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-72340fc6-f8be-4335-b40d-945a74321e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:14.737599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:14.815864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:14 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:15.109641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beaf1b-5905-4cc3-996f-b4739fb6e075 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:15.111179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e5beaf1b-5905-4cc3-996f-b4739fb6e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:15.221437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beaf1b-5905-4cc3-996f-b4739fb6e075 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:15.244248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:15.300979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:15.301589 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:15.301865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:15.302140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:15.303759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:15.422624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:15.425496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefb8c4-905a-45b0-a652-75983a6a9ca5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:15.444251 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 733/1452] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:15 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:17.470252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf7008-2d5c-44ad-a498-7452b6d7402c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:17.471320 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf7008-2d5c-44ad-a498-7452b6d7402c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:17.471510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf7008-2d5c-44ad-a498-7452b6d7402c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:17.472984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:17.478758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b09e7-172d-43d9-a545-2a37238eac60 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:17.479212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b09e7-172d-43d9-a545-2a37238eac60 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:17.479391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b09e7-172d-43d9-a545-2a37238eac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:17.543863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:17.546580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9e2b09e7-172d-43d9-a545-2a37238eac60 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:17.547806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9e2b09e7-172d-43d9-a545-2a37238eac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:17.646021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:17.939780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf7008-2d5c-44ad-a498-7452b6d7402c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:17.941346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6fcf7008-2d5c-44ad-a498-7452b6d7402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:18.045096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf7008-2d5c-44ad-a498-7452b6d7402c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:18.093500 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:18.119023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:18.119791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:18.120067 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:18.120365 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:18.121937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:18.239660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:18.241119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613865f-a430-44cc-b4a7-8987d279812d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:18.261190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 721/1455] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:20.266613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acb53c-f061-493e-b4ca-45fea63e735b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:20.268845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acb53c-f061-493e-b4ca-45fea63e735b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:20.268845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acb53c-f061-493e-b4ca-45fea63e735b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:20.269655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:20.275854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60731b1a-e819-42b2-b2db-a7ed59435386 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:20.276462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60731b1a-e819-42b2-b2db-a7ed59435386 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:20.276731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60731b1a-e819-42b2-b2db-a7ed59435386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:20.362831 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-60731b1a-e819-42b2-b2db-a7ed59435386 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:20.364239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-60731b1a-e819-42b2-b2db-a7ed59435386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:20.401063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:20.481495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:20.768455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acb53c-f061-493e-b4ca-45fea63e735b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:20.770167 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64acb53c-f061-493e-b4ca-45fea63e735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:20.899147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acb53c-f061-493e-b4ca-45fea63e735b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:20.936980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:20.994741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:20.995265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:20.995543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:20.995816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:20.997449 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:21.124259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:21.125721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a76c29-0dd1-45d0-963f-e4479d46144e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:21.145125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 736/1458] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:23.154258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8672-4bf6-44a2-a35d-6eb338651c26 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:23.154832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8672-4bf6-44a2-a35d-6eb338651c26 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:23.154832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8672-4bf6-44a2-a35d-6eb338651c26 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:23.156130 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:23.162599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dab29-336a-43cc-922c-4fa7a63003fc None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:23.163151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dab29-336a-43cc-922c-4fa7a63003fc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:23.163151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dab29-336a-43cc-922c-4fa7a63003fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:23.231656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f69dab29-336a-43cc-922c-4fa7a63003fc None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:23.232960 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f69dab29-336a-43cc-922c-4fa7a63003fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:23.242891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:23.335406 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:23.631276 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8672-4bf6-44a2-a35d-6eb338651c26 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:23.632830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-900c8672-4bf6-44a2-a35d-6eb338651c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:23.742783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8672-4bf6-44a2-a35d-6eb338651c26 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:23.798881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:23.820124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:23.820124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:23.820670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:23.820670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:23.822321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:23.937854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:23.939420 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b084de2-39a9-4e8c-b418-c1989e0d3d4f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:23.959209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 724/1461] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:26.020692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c439105-4da8-4cdc-ada5-cbce281ca17b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:26.021252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c439105-4da8-4cdc-ada5-cbce281ca17b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:26.021346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c439105-4da8-4cdc-ada5-cbce281ca17b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:26.022763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:26.028374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9dcb2-eefb-4c3e-8c89-32f39b05cd3d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:26.028840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9dcb2-eefb-4c3e-8c89-32f39b05cd3d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:26.028938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9dcb2-eefb-4c3e-8c89-32f39b05cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:26.100127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a7d9dcb2-eefb-4c3e-8c89-32f39b05cd3d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:26.101371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a7d9dcb2-eefb-4c3e-8c89-32f39b05cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:26.140427 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:26.205269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:26.497748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c439105-4da8-4cdc-ada5-cbce281ca17b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:26.499343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c439105-4da8-4cdc-ada5-cbce281ca17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:26.609924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c439105-4da8-4cdc-ada5-cbce281ca17b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:26.649458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:26.688608 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:26.689214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:26.690244 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:26.690525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:26.692131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:26.803346 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:26.804852 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8efda-8c7a-44c9-b896-a98e4628f7a1 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:26.823877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 739/1464] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:26 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:28.796274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79f6dd-06bc-438e-b5a4-cee013d60549 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:28.796999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79f6dd-06bc-438e-b5a4-cee013d60549 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:28.796999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79f6dd-06bc-438e-b5a4-cee013d60549 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:28.798242 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:28.804322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b81333-92a4-4f50-ab6d-cb1b4b86740a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:28.804851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b81333-92a4-4f50-ab6d-cb1b4b86740a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:28.804971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b81333-92a4-4f50-ab6d-cb1b4b86740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:28.874688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-70b81333-92a4-4f50-ab6d-cb1b4b86740a None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:28.875911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-70b81333-92a4-4f50-ab6d-cb1b4b86740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:28.894322 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:28.974268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:29.263012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79f6dd-06bc-438e-b5a4-cee013d60549 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:29.264571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ca79f6dd-06bc-438e-b5a4-cee013d60549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:29.373007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79f6dd-06bc-438e-b5a4-cee013d60549 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:29.445305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:29.452285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:29.452903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:29.458353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:29.458353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:29.458353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:29.569872 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:29.571339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7642d0-d0bd-489c-9565-5a8b29ae9304 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:29.590771 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 727/1467] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:31.544844 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe19a9-79b5-4dda-9c9f-047da811b1c4 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:31.545421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe19a9-79b5-4dda-9c9f-047da811b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:31.545421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe19a9-79b5-4dda-9c9f-047da811b1c4 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:31.546834 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:59:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:31.553023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033d352-473e-4586-aa3c-85d833f03690 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:31.553615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033d352-473e-4586-aa3c-85d833f03690 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:31.553615 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033d352-473e-4586-aa3c-85d833f03690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:31.621170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9033d352-473e-4586-aa3c-85d833f03690 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:31.622422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9033d352-473e-4586-aa3c-85d833f03690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:31.672455 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:31.724566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:32.013878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe19a9-79b5-4dda-9c9f-047da811b1c4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:32.015421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-87fe19a9-79b5-4dda-9c9f-047da811b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:32.128307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe19a9-79b5-4dda-9c9f-047da811b1c4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:32.178292 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:32.205828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:32.206453 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:32.206843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:32.207060 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:32.208707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:32.326106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:32.327551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1db65-38e5-4b74-8228-9e15469ef183 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:32.347129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 742/1470] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:41.722751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=22 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:42.344240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=66 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:52.813269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf5d7-c579-4f32-b87b-43ac94236f17 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:52.813842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf5d7-c579-4f32-b87b-43ac94236f17 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:52.813842 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf5d7-c579-4f32-b87b-43ac94236f17 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:52.815396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 729/1471] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:59:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:52.821092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcdd7-1a05-4c60-960e-e7877f7f9d64 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:52.821586 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcdd7-1a05-4c60-960e-e7877f7f9d64 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:52.821694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcdd7-1a05-4c60-960e-e7877f7f9d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:52.890858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f80dcdd7-1a05-4c60-960e-e7877f7f9d64 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:52.892106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f80dcdd7-1a05-4c60-960e-e7877f7f9d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:52.994806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 743/1472] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:59:52 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:53.296184 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03085b40-2c3e-470e-88bf-1147d5de3808 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:53.296509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03085b40-2c3e-470e-88bf-1147d5de3808 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:53.296779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03085b40-2c3e-470e-88bf-1147d5de3808 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:53.298114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 730/1473] 10.222.0.122 () {54 vars in 972 bytes} [Fri Aug 26 00:59:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:53.303799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95309408-a0fa-4d3b-9ac4-ad5719d7f306 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:53.304082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95309408-a0fa-4d3b-9ac4-ad5719d7f306 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:53.304388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95309408-a0fa-4d3b-9ac4-ad5719d7f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:53.385252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-95309408-a0fa-4d3b-9ac4-ad5719d7f306 None None] MFA Rules not processed for user `db0844a1faa142d2a469fe561e4b72ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:53.386475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-95309408-a0fa-4d3b-9ac4-ad5719d7f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:53.407512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:53.464802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 744/1474] 10.222.0.122 () {58 vars in 1069 bytes} [Fri Aug 26 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:53.472732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03085b40-2c3e-470e-88bf-1147d5de3808 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:53.474300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-03085b40-2c3e-470e-88bf-1147d5de3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:53.580250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03085b40-2c3e-470e-88bf-1147d5de3808 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:53.655099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db0844a1faa142d2a469fe561e4b72ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:53.655715 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:53.655998 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:53.656307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:53.657917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:53.714653 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:53.773329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:53.774774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b472d9-2ad5-414c-b1a0-854d1f7cbd99 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:53.794275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 731/1475] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:55.831764 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b2bc4-67bf-4083-aa58-b95d37fb65c1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:55.832354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b2bc4-67bf-4083-aa58-b95d37fb65c1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:55.832354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b2bc4-67bf-4083-aa58-b95d37fb65c1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:55.833782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 745/1476] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:59:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:55.839611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5292-146e-4bc8-bb89-d42e7c86e886 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:55.840141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5292-146e-4bc8-bb89-d42e7c86e886 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:55.840141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5292-146e-4bc8-bb89-d42e7c86e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:55.909647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-36ee5292-146e-4bc8-bb89-d42e7c86e886 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:55.910944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-36ee5292-146e-4bc8-bb89-d42e7c86e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:56.013798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 732/1477] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:59:56.303743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b2bc4-67bf-4083-aa58-b95d37fb65c1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:56.305331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a80b2bc4-67bf-4083-aa58-b95d37fb65c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:56.445637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b2bc4-67bf-4083-aa58-b95d37fb65c1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:56.495839 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:56.542105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:56.542681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:56.542958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:56.543229 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:56.543864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:56.545750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:59:56.545750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 00:59:56.545750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 00:59:56.546888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cbffc-3b7b-4bdd-b014-8f6233f310c7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:56.568185 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 746/1478] 10.222.0.122 () {56 vars in 1113 bytes} [Fri Aug 26 00:59:56 2022] GET /identity/v3/projects => generated 2562 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:59:58.560578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fabe08-bd7b-4650-b551-5b70602a254f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:58.561239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fabe08-bd7b-4650-b551-5b70602a254f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:58.561239 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fabe08-bd7b-4650-b551-5b70602a254f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:58.562470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 733/1479] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 00:59:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:59:58.568429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a989-d464-4c80-962d-7d6ad1b8aa48 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:58.568898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a989-d464-4c80-962d-7d6ad1b8aa48 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:58.569017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a989-d464-4c80-962d-7d6ad1b8aa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:58.758113 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-52e0a989-d464-4c80-962d-7d6ad1b8aa48 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:58.759327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-52e0a989-d464-4c80-962d-7d6ad1b8aa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:58.860733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 747/1480] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:59.164393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fabe08-bd7b-4650-b551-5b70602a254f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:59.165825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-17fabe08-bd7b-4650-b551-5b70602a254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:59.177738 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:59.321129 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fabe08-bd7b-4650-b551-5b70602a254f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:59.403520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:59.439899 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:59.441106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:59.441391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:59.441664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:59.443255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:59.535456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:59.537092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda54f0c-264c-4e0c-b7ba-da0278851a58 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:59.557124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 734/1481] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 00:59:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:00:01.770634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53ae2-f24c-4cef-8d62-d1bf5a4ad78d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:01.770634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53ae2-f24c-4cef-8d62-d1bf5a4ad78d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:01.770634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53ae2-f24c-4cef-8d62-d1bf5a4ad78d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:01.771407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 748/1482] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 01:00:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:00:01.776519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c754-5520-4522-bee2-7cc447238810 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:01.776991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c754-5520-4522-bee2-7cc447238810 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:01.777102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c754-5520-4522-bee2-7cc447238810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:01.847077 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3335c754-5520-4522-bee2-7cc447238810 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:00:01.848572 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3335c754-5520-4522-bee2-7cc447238810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:01.895626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:01.948029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 735/1483] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:00:02.243079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53ae2-f24c-4cef-8d62-d1bf5a4ad78d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:00:02.244674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-04f53ae2-f24c-4cef-8d62-d1bf5a4ad78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:02.269832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:02.354751 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53ae2-f24c-4cef-8d62-d1bf5a4ad78d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:00:02.429550 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:00:02.430158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:02.430433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:02.430699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:02.432665 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:02.508026 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:02.547015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:00:02.548492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5edb-dcb1-4a1d-8fd9-1f0a437009c3 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:00:02.567739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 749/1484] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:00:04.564944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b086d-e936-402d-a3b5-7ffcf8b2a03a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:04.565527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b086d-e936-402d-a3b5-7ffcf8b2a03a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:04.565527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b086d-e936-402d-a3b5-7ffcf8b2a03a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:04.566817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 736/1485] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 01:00:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:00:04.572179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b045-987f-49b9-bfdf-fd643075ec3b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:04.572675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b045-987f-49b9-bfdf-fd643075ec3b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:04.572777 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b045-987f-49b9-bfdf-fd643075ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:04.640683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4b66b045-987f-49b9-bfdf-fd643075ec3b None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:00:04.641904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4b66b045-987f-49b9-bfdf-fd643075ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:04.739486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 750/1486] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:00:05.037412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b086d-e936-402d-a3b5-7ffcf8b2a03a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:00:05.039056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ad8b086d-e936-402d-a3b5-7ffcf8b2a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:05.151434 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b086d-e936-402d-a3b5-7ffcf8b2a03a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:00:05.229212 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:05.231048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:00:05.231753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:05.232031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:05.232326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:05.233950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:05.349735 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:00:05.351181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517413ea-57cb-4ba7-9cbb-eff56a4bb747 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:00:05.369509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 737/1487] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:00:05 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:00:07.439835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01b46b-4ecb-4594-ba1b-29637950cd64 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:07.439835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01b46b-4ecb-4594-ba1b-29637950cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:07.440493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01b46b-4ecb-4594-ba1b-29637950cd64 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:07.441525 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 751/1488] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 01:00:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:00:07.447294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364c65-b241-421c-ab12-c19c6fdaedc0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:07.447781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364c65-b241-421c-ab12-c19c6fdaedc0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:07.447907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364c65-b241-421c-ab12-c19c6fdaedc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:07.515796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4b364c65-b241-421c-ab12-c19c6fdaedc0 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:00:07.517050 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4b364c65-b241-421c-ab12-c19c6fdaedc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:07.570234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:07.614647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 738/1489] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:00:07.910218 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01b46b-4ecb-4594-ba1b-29637950cd64 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:00:07.911749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cd01b46b-4ecb-4594-ba1b-29637950cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:07.948128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:08.018029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01b46b-4ecb-4594-ba1b-29637950cd64 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:00:08.091693 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:00:08.092327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:08.092602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:08.092869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:08.094476 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:08.175991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:08.207298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:00:08.209298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1b12-f3d2-4ed3-88d1-2b0c009ca72e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:00:08.228300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 752/1490] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:00:07 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:00:10.657491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b801-01f5-4289-a6b7-31b365a02e6d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:10.658068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b801-01f5-4289-a6b7-31b365a02e6d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:10.658068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b801-01f5-4289-a6b7-31b365a02e6d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:10.659909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 739/1491] 10.222.0.122 () {54 vars in 932 bytes} [Fri Aug 26 01:00:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:00:10.665473 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ee82-92f8-43f6-855d-2a128b135599 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:10.665935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ee82-92f8-43f6-855d-2a128b135599 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:10.666043 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ee82-92f8-43f6-855d-2a128b135599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:10.738975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-74a8ee82-92f8-43f6-855d-2a128b135599 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:00:10.740599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-74a8ee82-92f8-43f6-855d-2a128b135599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:10.843832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 753/1492] 10.222.0.122 () {58 vars in 1029 bytes} [Fri Aug 26 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:00:11.137044 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0b801-01f5-4289-a6b7-31b365a02e6d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:00:11.138603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-88f0b801-01f5-4289-a6b7-31b365a02e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:11.246657 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0b801-01f5-4289-a6b7-31b365a02e6d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:00:11.324059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:00:11.324704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:00:11.324983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:00:11.325255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:00:11.326922 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:00:11.336846 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:11.442469 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:00:11.443892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95913f9c-9616-47f5-8db3-9f49ccf3f3d1 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:00:11.461886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 740/1493] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:00:20.842015 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=82 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:00:21.459533 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=50 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:35.386140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:35.386746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:35.386746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:35.465327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:35.466541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:35.560063 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 754/1494] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:35.568975 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:35.569503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:35.569610 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:35.644758 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:35.646585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:35.744389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 741/1495] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:35.749035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:35.750279 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:35.762360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14a7c7-ddee-4a26-871c-7954e389be9d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:35.827573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:35.862716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:35.863323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:35.863602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:35.863869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:35.865032 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 01:01:35.865871 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:35.866888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:35.866888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:01:35.866888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:01:35.867780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:35.879824 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 755/1496] 10.222.0.122 () {58 vars in 1158 bytes} [Fri Aug 26 01:01:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 01:01:35.890401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:35.900252 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb4a1-625e-4e33-8dca-c4e3f427d9ba None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:35.963017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:35.996719 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:35.997323 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:35.997600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:35.997869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:35.998506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:36.000410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:36.000410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:01:36.000410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:01:36.002023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:36.119731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 742/1497] 10.222.0.122 () {60 vars in 1158 bytes} [Fri Aug 26 01:01:35 2022] POST /identity/v3/projects => generated 380 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:01:36.124073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:36.125594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:36.158810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee58f6-d795-444d-9326-de9020f7618e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:36.254866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:36.255509 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:36.255782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:36.256049 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:36.256690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:36.257742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:36.257742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:01:36.257742 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:01:36.258937 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:36.332778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 756/1498] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 01:01:36 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:01:36.337489 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:36.339352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:36.405115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba92e-b739-444c-8733-585ef57f97cd admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:36.486552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:36.497030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:01:36.500948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:01:36.501658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:36.514070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 743/1499] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:01:36 2022] GET /identity/v3/roles => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:01:36.518293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:36.534381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:36.534381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3672861-17c0-48be-8220-4a8b22688294 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:36.557877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:36.629874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:36.630582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:36.630854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:36.631120 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:36.631748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:36.632781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:36.632781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:01:36.632781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:01:36.633658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce49d1-58ed-4067-9d1c-d1641c3da610 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:36.645655 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 757/1500] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:01:36 2022] GET /identity/v3/roles => generated 1427 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:01:36.650671 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:36.652174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:36.685018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d38e-d73e-4268-a378-8640e6ddf7a8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:36.782745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:36.783338 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:36.783617 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:36.783890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] PATH_INFO: `/v3/projects/fe7a07e039dc47cb87cbac131047171c/users/96637b388cde452a8d69c3f7f1e39ce6/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:36.808658 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7a07e039dc47cb87cbac131047171c, user_id=96637b388cde452a8d69c3f7f1e39ce6, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:36.809684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:36.809684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:01:36.809684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:01:36.811647 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc52650-d699-4515-ae69-40a88f7b447f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:36.894761 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 744/1501] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:01:36 2022] PUT /identity/v3/projects/fe7a07e039dc47cb87cbac131047171c/users/96637b388cde452a8d69c3f7f1e39ce6/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:01:36.907524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646e996-5c74-4e35-be3a-1a2ccebbb03c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:36.907815 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646e996-5c74-4e35-be3a-1a2ccebbb03c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:36.908089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646e996-5c74-4e35-be3a-1a2ccebbb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:36.969273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4646e996-5c74-4e35-be3a-1a2ccebbb03c None None] MFA Rules not processed for user `96637b388cde452a8d69c3f7f1e39ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:36.970515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4646e996-5c74-4e35-be3a-1a2ccebbb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:37.047668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 758/1502] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:37.060661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8eb29-9e4b-4640-9d69-e4eab795bae3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:37.060948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8eb29-9e4b-4640-9d69-e4eab795bae3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:37.061220 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8eb29-9e4b-4640-9d69-e4eab795bae3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:37.062546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 745/1503] 10.222.0.122 () {54 vars in 969 bytes} [Fri Aug 26 01:01:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:01:37.067385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba14ea-ea25-4433-9507-0741e2fc2e4c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:37.068232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba14ea-ea25-4433-9507-0741e2fc2e4c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:37.068952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba14ea-ea25-4433-9507-0741e2fc2e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:37.102439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:37.149199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-08ba14ea-ea25-4433-9507-0741e2fc2e4c None None] MFA Rules not processed for user `e77f464caecc4799b2c310ea640a3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:37.150447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-08ba14ea-ea25-4433-9507-0741e2fc2e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:37.228084 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 759/1504] 10.222.0.122 () {58 vars in 1066 bytes} [Fri Aug 26 01:01:37 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:37.235756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8eb29-9e4b-4640-9d69-e4eab795bae3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:37.237316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-28e8eb29-9e4b-4640-9d69-e4eab795bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:37.287854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:37.345017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8eb29-9e4b-4640-9d69-e4eab795bae3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:37.419010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77f464caecc4799b2c310ea640a3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:37.419664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:37.420027 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:37.420233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:37.421825 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:37.522724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:37.524179 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:37.531853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:37.541692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 746/1505] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:01:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:01:37.587811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06ea8-5dd7-4f5f-9e8e-8916535861c5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:37.588274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06ea8-5dd7-4f5f-9e8e-8916535861c5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:37.588392 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06ea8-5dd7-4f5f-9e8e-8916535861c5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:37.589885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 760/1506] 10.222.0.122 () {52 vars in 835 bytes} [Fri Aug 26 01:01:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:01:37.593545 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:37.594750 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:37.694412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c5c7-8328-42bf-ad75-68e90d12b18d service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:37.787440 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:37.788072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:37.788373 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:37.788646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] PATH_INFO: `/v3/users/96637b388cde452a8d69c3f7f1e39ce6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:37.801246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=96637b388cde452a8d69c3f7f1e39ce6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:37.803334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:37.803334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:01:37.803334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:01:37.804291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:37.814640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:38.103133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96637b388cde452a8d69c3f7f1e39ce6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:38.103574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96637b388cde452a8d69c3f7f1e39ce6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:38.104088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96637b388cde452a8d69c3f7f1e39ce6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:38.127875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96637b388cde452a8d69c3f7f1e39ce6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:38.195400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96637b388cde452a8d69c3f7f1e39ce6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:38.216082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 747/1507] 10.222.0.122 () {58 vars in 1229 bytes} [Fri Aug 26 01:01:37 2022] DELETE /identity/v3/users/96637b388cde452a8d69c3f7f1e39ce6 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:01:38.220661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:38.220942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:38.221213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:38.278716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:38.279918 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:38.358854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:38.371202 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 761/1508] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:38.381444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:38.382680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:38.483430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55527a5-72de-454a-8d4e-23f6090332cb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:38.657982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:38.676570 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:38.677291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:38.677291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:38.677997 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:38.679281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:38.792938 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:38.794359 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe758b-9d36-4580-986f-8b1369ccf4bf service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:38.812956 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 748/1509] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:01:39.272702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:39.274125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:39.286371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ad641-929b-4697-8956-ad49abaa5936 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:39.385966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:39.386557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:39.386704 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:39.386976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] PATH_INFO: `/v3/projects/fe7a07e039dc47cb87cbac131047171c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:39.397769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7a07e039dc47cb87cbac131047171c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:39.398942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:01:39.398942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:01:39.398942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:01:39.400278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:39.503022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7a07e039dc47cb87cbac131047171c', 'request_id': 'req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:39.561119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7a07e039dc47cb87cbac131047171c', 'request_id': 'req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:39.570299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7a07e039dc47cb87cbac131047171c', 'request_id': 'req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:39.601454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] The token cache is being invalidate because project fe7a07e039dc47cb87cbac131047171c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:01:39.601740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:39.602164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f97f6a72-5319-4c6d-b4fd-75e6dba7af21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:01:39.603571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 762/1510] 10.222.0.122 () {58 vars in 1238 bytes} [Fri Aug 26 01:01:39 2022] DELETE /identity/v3/projects/fe7a07e039dc47cb87cbac131047171c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:01:48.810688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=62 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:49.598984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:59.498984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0f989-41d8-4b7b-8dbc-351fbc89157b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:59.499592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0f989-41d8-4b7b-8dbc-351fbc89157b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:59.499592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0f989-41d8-4b7b-8dbc-351fbc89157b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:59.500895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:02:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:59.506492 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbbeb-e589-4815-b989-42a81b207dec None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:59.506958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbbeb-e589-4815-b989-42a81b207dec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:59.507065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbbeb-e589-4815-b989-42a81b207dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:59.591994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e2ebbbeb-e589-4815-b989-42a81b207dec None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:59.593262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e2ebbbeb-e589-4815-b989-42a81b207dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:59.703155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:59.862963 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0f989-41d8-4b7b-8dbc-351fbc89157b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:59.865117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0dc0f989-41d8-4b7b-8dbc-351fbc89157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:59.981889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0f989-41d8-4b7b-8dbc-351fbc89157b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:59.987613 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322909e1-61f7-4f88-b248-2295d124a0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:59.988382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322909e1-61f7-4f88-b248-2295d124a0d4 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:59.988661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322909e1-61f7-4f88-b248-2295d124a0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:59.988930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322909e1-61f7-4f88-b248-2295d124a0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:59.996934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322909e1-61f7-4f88-b248-2295d124a0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:59.998507 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322909e1-61f7-4f88-b248-2295d124a0d4 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:00.008744 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 750/1513] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:00.839566 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b6ae-a263-4ed8-b022-8b878b6e3fe1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:00.840141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b6ae-a263-4ed8-b022-8b878b6e3fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:00.840141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b6ae-a263-4ed8-b022-8b878b6e3fe1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:00.841463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:03:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:00.846236 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841122-8977-4913-a861-6c38186684ce None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:00.847219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841122-8977-4913-a861-6c38186684ce None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:00.847514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841122-8977-4913-a861-6c38186684ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:00.867241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-17841122-8977-4913-a861-6c38186684ce None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:00.868464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-17841122-8977-4913-a861-6c38186684ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:00.876224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:01.026559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b6ae-a263-4ed8-b022-8b878b6e3fe1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:01.041431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b6ae-a263-4ed8-b022-8b878b6e3fe1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:01.047931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb54df-452a-4ee2-ac9c-74ee7182f22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:01.048563 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb54df-452a-4ee2-ac9c-74ee7182f22f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:01.048838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb54df-452a-4ee2-ac9c-74ee7182f22f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:01.049103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb54df-452a-4ee2-ac9c-74ee7182f22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:01.057874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb54df-452a-4ee2-ac9c-74ee7182f22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:01.059445 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb54df-452a-4ee2-ac9c-74ee7182f22f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:01.068748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 765/1516] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:06.064595 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbb198-2c6e-4563-a91a-4ba87c528f68 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:06.065699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbb198-2c6e-4563-a91a-4ba87c528f68 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:06.065699 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbb198-2c6e-4563-a91a-4ba87c528f68 None None] PATH_INFO: `/v3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:06.066980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 752/1517] 10.222.0.40 () {54 vars in 929 bytes} [Fri Aug 26 01:03:06 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 01:03:06.076775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713d526-35ff-4f42-849b-dddd69858f95 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:06.077234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713d526-35ff-4f42-849b-dddd69858f95 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:06.077339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713d526-35ff-4f42-849b-dddd69858f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:06.139408 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7713d526-35ff-4f42-849b-dddd69858f95 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:06.140623 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7713d526-35ff-4f42-849b-dddd69858f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:06.157732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:06.212718 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 766/1518] 10.222.0.40 () {58 vars in 1019 bytes} [Fri Aug 26 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:10.862233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=56 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:12.310400 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cc4b-e64e-493f-850f-3729ec97eda6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:12.311081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cc4b-e64e-493f-850f-3729ec97eda6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:12.311081 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cc4b-e64e-493f-850f-3729ec97eda6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:12.312330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 753/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:03:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:12.317326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d75d-205c-4c0d-9dac-20805fdb8dae None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:12.317749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d75d-205c-4c0d-9dac-20805fdb8dae None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:12.317878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d75d-205c-4c0d-9dac-20805fdb8dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:12.338240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4c51d75d-205c-4c0d-9dac-20805fdb8dae None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:12.339465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4c51d75d-205c-4c0d-9dac-20805fdb8dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:12.348371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 767/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:12.504222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21cc4b-e64e-493f-850f-3729ec97eda6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:12.519115 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21cc4b-e64e-493f-850f-3729ec97eda6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:12.524716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5e323-275d-4ba9-bfe5-beb81c15ba44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:12.525313 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e323-275d-4ba9-bfe5-beb81c15ba44 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:12.525592 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e323-275d-4ba9-bfe5-beb81c15ba44 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:12.525864 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e323-275d-4ba9-bfe5-beb81c15ba44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:12.534930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5e323-275d-4ba9-bfe5-beb81c15ba44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:12.537736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5e323-275d-4ba9-bfe5-beb81c15ba44 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:12.546106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 754/1521] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:13.387401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17eae-43c0-45e5-94db-72a61c0b3a3c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:13.387969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17eae-43c0-45e5-94db-72a61c0b3a3c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:13.387969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17eae-43c0-45e5-94db-72a61c0b3a3c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:13.389321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:03:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:13.394343 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1a48-b6d2-4851-8644-55a319823b42 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:13.394794 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1a48-b6d2-4851-8644-55a319823b42 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:13.394903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1a48-b6d2-4851-8644-55a319823b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:13.414765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-92bb1a48-b6d2-4851-8644-55a319823b42 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:13.415971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-92bb1a48-b6d2-4851-8644-55a319823b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:13.423823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:13.575238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17eae-43c0-45e5-94db-72a61c0b3a3c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:13.590477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17eae-43c0-45e5-94db-72a61c0b3a3c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:13.595881 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690de153-3f60-4de9-8e10-82ced679fcef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:13.597561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de153-3f60-4de9-8e10-82ced679fcef service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:13.597838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de153-3f60-4de9-8e10-82ced679fcef service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:13.598112 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de153-3f60-4de9-8e10-82ced679fcef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:13.606226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690de153-3f60-4de9-8e10-82ced679fcef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:13.607971 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690de153-3f60-4de9-8e10-82ced679fcef service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:13.619225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 769/1524] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:17.733558 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923df7-3a18-4f63-83be-7c60957ce896 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:17.734048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923df7-3a18-4f63-83be-7c60957ce896 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:17.734048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923df7-3a18-4f63-83be-7c60957ce896 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:17.735358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 756/1525] 10.222.0.122 () {54 vars in 966 bytes} [Fri Aug 26 01:03:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:17.741124 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d7788-62b4-43b9-bc4f-a0e6299da9db None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:17.741574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d7788-62b4-43b9-bc4f-a0e6299da9db None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:17.741682 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d7788-62b4-43b9-bc4f-a0e6299da9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:17.761337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ec5d7788-62b4-43b9-bc4f-a0e6299da9db None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:17.762523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ec5d7788-62b4-43b9-bc4f-a0e6299da9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:17.771618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 770/1526] 10.222.0.122 () {58 vars in 1063 bytes} [Fri Aug 26 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:17.779261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923df7-3a18-4f63-83be-7c60957ce896 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:17.793762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923df7-3a18-4f63-83be-7c60957ce896 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:17.798633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c118844-ca47-421f-a68d-de3396877a82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:17.799223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c118844-ca47-421f-a68d-de3396877a82 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:17.799497 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c118844-ca47-421f-a68d-de3396877a82 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:17.799760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c118844-ca47-421f-a68d-de3396877a82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:17.809126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c118844-ca47-421f-a68d-de3396877a82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:17.810702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c118844-ca47-421f-a68d-de3396877a82 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:17.820515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 757/1527] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:24.821174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be285f9-7c4f-4d75-9ded-db643816eba4 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:24.821743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be285f9-7c4f-4d75-9ded-db643816eba4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:24.821743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be285f9-7c4f-4d75-9ded-db643816eba4 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:24.823066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:03:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:24.827916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cac5fa-3bef-43cc-9a0c-aaa28198a6a6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:24.828463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cac5fa-3bef-43cc-9a0c-aaa28198a6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:24.828741 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cac5fa-3bef-43cc-9a0c-aaa28198a6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:24.849030 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-89cac5fa-3bef-43cc-9a0c-aaa28198a6a6 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:24.850248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-89cac5fa-3bef-43cc-9a0c-aaa28198a6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:24.858138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:25.018211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be285f9-7c4f-4d75-9ded-db643816eba4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:25.034274 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be285f9-7c4f-4d75-9ded-db643816eba4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:25.040683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97b6d0-f0ad-4a2d-ba31-724faa03766a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:25.041309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97b6d0-f0ad-4a2d-ba31-724faa03766a service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:25.041590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97b6d0-f0ad-4a2d-ba31-724faa03766a service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:25.041855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97b6d0-f0ad-4a2d-ba31-724faa03766a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:25.050958 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97b6d0-f0ad-4a2d-ba31-724faa03766a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:25.052911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97b6d0-f0ad-4a2d-ba31-724faa03766a service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:25.063315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 772/1530] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:25 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:25.929443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b3db-9350-49ac-b219-4379d7a9168a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:25.930029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b3db-9350-49ac-b219-4379d7a9168a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:25.930029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843b3db-9350-49ac-b219-4379d7a9168a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:25.931450 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:03:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:25.937446 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7235a3-f40f-4c50-9bf0-b7c61e9eb927 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:25.937967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7235a3-f40f-4c50-9bf0-b7c61e9eb927 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:25.937967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7235a3-f40f-4c50-9bf0-b7c61e9eb927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:25.957539 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0d7235a3-f40f-4c50-9bf0-b7c61e9eb927 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:25.959302 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0d7235a3-f40f-4c50-9bf0-b7c61e9eb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:25.967360 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:03:26.122585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b3db-9350-49ac-b219-4379d7a9168a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:26.137386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843b3db-9350-49ac-b219-4379d7a9168a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:26.142607 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403823a-b46b-4513-a65f-2c13124827d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:26.143190 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403823a-b46b-4513-a65f-2c13124827d3 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:26.143463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403823a-b46b-4513-a65f-2c13124827d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:26.143727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403823a-b46b-4513-a65f-2c13124827d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:26.152485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403823a-b46b-4513-a65f-2c13124827d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:26.154053 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403823a-b46b-4513-a65f-2c13124827d3 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:26.163410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 760/1533] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:30.077307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514b54-f974-4c8b-871a-4f45c2ec6d58 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:30.077889 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514b54-f974-4c8b-871a-4f45c2ec6d58 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:30.078221 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514b54-f974-4c8b-871a-4f45c2ec6d58 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:30.080620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:03:30 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:30.087847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115525ea-40b7-4bc9-adb7-a7f22e2d3ba8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:30.088370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115525ea-40b7-4bc9-adb7-a7f22e2d3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:30.088468 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115525ea-40b7-4bc9-adb7-a7f22e2d3ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:30.108541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-115525ea-40b7-4bc9-adb7-a7f22e2d3ba8 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:30.109757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-115525ea-40b7-4bc9-adb7-a7f22e2d3ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:30.118828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:30.404331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514b54-f974-4c8b-871a-4f45c2ec6d58 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:30.406040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-12514b54-f974-4c8b-871a-4f45c2ec6d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:30.486953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514b54-f974-4c8b-871a-4f45c2ec6d58 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:30.490929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7ff2b-c2da-4de8-b5de-4d801ce17ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:30.491531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7ff2b-c2da-4de8-b5de-4d801ce17ccc service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:30.491810 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7ff2b-c2da-4de8-b5de-4d801ce17ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:30.492082 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7ff2b-c2da-4de8-b5de-4d801ce17ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:30.501080 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7ff2b-c2da-4de8-b5de-4d801ce17ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:30.502519 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7ff2b-c2da-4de8-b5de-4d801ce17ccc service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:30.512674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 775/1536] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:32.461631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca904a6-d340-437a-ba7d-e3114b3de99e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:32.462151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca904a6-d340-437a-ba7d-e3114b3de99e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:32.462151 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca904a6-d340-437a-ba7d-e3114b3de99e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:32.463437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:03:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:32.468965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bb9a0-ae1c-4979-9089-473ffd78dfed None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:32.469396 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bb9a0-ae1c-4979-9089-473ffd78dfed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:32.469531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bb9a0-ae1c-4979-9089-473ffd78dfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:32.490414 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-638bb9a0-ae1c-4979-9089-473ffd78dfed None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:32.491626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-638bb9a0-ae1c-4979-9089-473ffd78dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:32.499599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:32.798311 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca904a6-d340-437a-ba7d-e3114b3de99e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:32.809667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca904a6-d340-437a-ba7d-e3114b3de99e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:32.813206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c7211-51a7-4355-b195-fe0bd609ff62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:32.813765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7211-51a7-4355-b195-fe0bd609ff62 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:32.814040 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7211-51a7-4355-b195-fe0bd609ff62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:32.814349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7211-51a7-4355-b195-fe0bd609ff62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:32.823199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7211-51a7-4355-b195-fe0bd609ff62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:32.824681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7211-51a7-4355-b195-fe0bd609ff62 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:32.833816 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 763/1539] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:03:36.320603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af22f-3082-4eae-ab81-d9cef7a8354c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:36.321206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af22f-3082-4eae-ab81-d9cef7a8354c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:36.321206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af22f-3082-4eae-ab81-d9cef7a8354c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:36.322484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 777/1540] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:03:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:36.327894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e3f2c-dbbe-4d88-8d96-62e8404133e7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:36.328389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e3f2c-dbbe-4d88-8d96-62e8404133e7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:36.328486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e3f2c-dbbe-4d88-8d96-62e8404133e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:36.349720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7e3e3f2c-dbbe-4d88-8d96-62e8404133e7 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:36.350920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7e3e3f2c-dbbe-4d88-8d96-62e8404133e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:36.358661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 764/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:36.917123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af22f-3082-4eae-ab81-d9cef7a8354c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:36.918812 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ab3af22f-3082-4eae-ab81-d9cef7a8354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:36.923010 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=83 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:36.998637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af22f-3082-4eae-ab81-d9cef7a8354c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:37.002138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b15b7-ba21-4b2b-b7a9-bf8952f7a394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77f464caecc4799b2c310ea640a3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:37.002762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b15b7-ba21-4b2b-b7a9-bf8952f7a394 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:37.003012 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b15b7-ba21-4b2b-b7a9-bf8952f7a394 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:37.003278 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b15b7-ba21-4b2b-b7a9-bf8952f7a394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:37.012250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b15b7-ba21-4b2b-b7a9-bf8952f7a394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:37.013635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b15b7-ba21-4b2b-b7a9-bf8952f7a394 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:37.023463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 778/1542] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:38.969088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679007-3f11-448b-b01c-719d233c98b3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:38.969677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679007-3f11-448b-b01c-719d233c98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:38.969677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679007-3f11-448b-b01c-719d233c98b3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:38.970855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 765/1543] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:03:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:38.976611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd163f-389b-4b31-b500-c44d4f594a09 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:38.977126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd163f-389b-4b31-b500-c44d4f594a09 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:38.977224 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd163f-389b-4b31-b500-c44d4f594a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:38.996280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-93cd163f-389b-4b31-b500-c44d4f594a09 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:38.997498 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-93cd163f-389b-4b31-b500-c44d4f594a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:39.005995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 779/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:39.564515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679007-3f11-448b-b01c-719d233c98b3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:39.566256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bf679007-3f11-448b-b01c-719d233c98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:39.579425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679007-3f11-448b-b01c-719d233c98b3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:39.583260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1b80e-b1d3-4f80-be00-15cae3b3180d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77f464caecc4799b2c310ea640a3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:39.583888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1b80e-b1d3-4f80-be00-15cae3b3180d service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:39.584183 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1b80e-b1d3-4f80-be00-15cae3b3180d service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:39.584459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1b80e-b1d3-4f80-be00-15cae3b3180d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:39.593967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1b80e-b1d3-4f80-be00-15cae3b3180d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:39.595930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1b80e-b1d3-4f80-be00-15cae3b3180d service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:39.606548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 766/1545] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:39 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:48.991042 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=37 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:49.602038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=42 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:01.519452 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e06ed-3803-4465-888c-f95fc4179bf0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.520191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e06ed-3803-4465-888c-f95fc4179bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.520191 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e06ed-3803-4465-888c-f95fc4179bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.520877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283eec-d1ff-4349-bb25-1f266c204356 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.521442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283eec-d1ff-4349-bb25-1f266c204356 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.521552 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283eec-d1ff-4349-bb25-1f266c204356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.543003 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a98e06ed-3803-4465-888c-f95fc4179bf0 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:01.543661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-91283eec-d1ff-4349-bb25-1f266c204356 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:01.544425 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a98e06ed-3803-4465-888c-f95fc4179bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:01.544909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-91283eec-d1ff-4349-bb25-1f266c204356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:01.552672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 780/1546] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:01.553684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 767/1547] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:05:01.561808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.562125 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.562485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.570283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.570283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.570283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.583314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:01.584885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:01.590456 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:01.591714 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:01.594068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 781/1548] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:01.598731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:01.600348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 768/1549] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:05:01.606009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:01.609999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c41371-f6fd-4a8a-b3e0-4b268c98326b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:01.614733 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:01.615345 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.615542 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec824-188b-484b-b6b8-30539f441f92 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:01.615696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.615884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.616598 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 01:05:01.616898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:01.618843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:01.621265 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:01.621886 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.622159 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.622436 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.623233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 01:05:01.623538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:01.624590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:01.624590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:05:01.624590 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:05:01.625480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:01.631783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 782/1550] 10.222.0.122 () {58 vars in 1158 bytes} [Fri Aug 26 01:05:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 01:05:01.640433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:01.646382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 769/1551] 10.222.0.122 () {58 vars in 1158 bytes} [Fri Aug 26 01:05:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 01:05:01.651238 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f659e-c669-414a-845d-e51436e12d95 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:01.655584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:01.656503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:01.657123 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.657398 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.657668 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.658287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:01.659307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:01.659307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:05:01.659307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:05:01.660535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:01.666391 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49aae8-6056-45b8-876d-1011ae730f14 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:01.670932 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:01.671529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.671804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.672072 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.672720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:01.674641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:01.800356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 783/1552] 10.222.0.122 () {60 vars in 1158 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/projects => generated 378 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:05:01.804578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:01.834767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 770/1553] 10.222.0.122 () {60 vars in 1158 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/projects => generated 384 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:05:01.839941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:01.875330 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f284e-6657-4d05-b187-33b9ff6d0e20 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:01.904911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988938-fef7-41e7-92a0-d7fa783c6876 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:01.909868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:01.910491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.910769 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.911039 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.911659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:01.912776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:01.912776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:05:01.912776 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:05:01.914494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:01.938475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:01.942275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:01.942275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:01.942275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:01.942275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:01.942633 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.017009 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 771/1554] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:05:02.021281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.031631 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 784/1555] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 01:05:01 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:05:02.032799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e465-3ac1-47e9-9ae1-e787e5256d61 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.032934 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.037677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.038305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.038587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.038870 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.039527 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.041296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.043894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe01e7-5f70-42ea-99f7-f779b5a4237b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.051371 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.052297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.052748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.053200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.054211 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.057038 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.059380 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 772/1556] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:02 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:05:02.064079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.076906 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 785/1557] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:02 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:05:02.078374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.079848 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a15e-65d1-4688-a459-0a7714fefabf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.087341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.087972 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.088334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.088611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.089263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.090969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.093046 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aa93a-cf18-455f-820c-4e0cd7775789 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.098638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.099250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.099524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.099887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.100666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.102462 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.103230 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 773/1558] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:02 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:05:02.108890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.119138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 786/1559] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:02 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:05:02.119947 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71f71-22f8-432a-b087-12bc0d7af891 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.122737 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.125036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8be43e-8936-48aa-8b6a-6b34e6c88b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.125701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8be43e-8936-48aa-8b6a-6b34e6c88b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.125983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8be43e-8936-48aa-8b6a-6b34e6c88b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.126259 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8be43e-8936-48aa-8b6a-6b34e6c88b66 admin admin] PATH_INFO: `/v3/projects/474041b004b74f83a55cb1e0bf0c2e94/users/61da777a46a042a3ba0e47e1ceef5f4c/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.136333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff44ac5-1669-49a0-8376-5be6a3a4bb01 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.142471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.143340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.143720 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.143909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8be43e-8936-48aa-8b6a-6b34e6c88b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474041b004b74f83a55cb1e0bf0c2e94, user_id=61da777a46a042a3ba0e47e1ceef5f4c, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.144196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] PATH_INFO: `/v3/projects/26af9156aa814fc1a38a6c2019025e74/users/51636264c13e442092f054934e32f0b3/roles/14eb7ac5d26b4fcea5d73f096f87415b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.146745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8be43e-8936-48aa-8b6a-6b34e6c88b66 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.162711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26af9156aa814fc1a38a6c2019025e74, user_id=51636264c13e442092f054934e32f0b3, role_id=14eb7ac5d26b4fcea5d73f096f87415b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.168029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:02.168029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:05:02.168029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:05:02.168029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968dc75-af95-49ff-836d-7350ff733d92 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.168475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:02.281567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 774/1560] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:05:02 2022] PUT /identity/v3/projects/474041b004b74f83a55cb1e0bf0c2e94/users/61da777a46a042a3ba0e47e1ceef5f4c/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:05:02.288131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.288579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.290105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.301158 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 787/1561] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:05:02 2022] PUT /identity/v3/projects/26af9156aa814fc1a38a6c2019025e74/users/51636264c13e442092f054934e32f0b3/roles/14eb7ac5d26b4fcea5d73f096f87415b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:05:02.302829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.303522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.303711 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.316459 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:02.322885 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:02.325394 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] MFA Rules not processed for user `609e79f5aa004dde93c22ba285ca6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:02.327198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:02.382994 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:02.395467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 775/1562] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:02.408356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.410792 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 788/1563] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:02.424021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:02.425929 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:02.517018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a719-d2ff-4290-8d5f-d4c3714320d9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.518393 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f503e4-194f-4be1-a922-616e9660c6f1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:02.520691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5253-6770-4392-b2ca-483cccebc298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.532312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5253-6770-4392-b2ca-483cccebc298 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.532312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5253-6770-4392-b2ca-483cccebc298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.532312 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5253-6770-4392-b2ca-483cccebc298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.532621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241860-5f76-4e7d-b7be-055615e96da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:02.532621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241860-5f76-4e7d-b7be-055615e96da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:02.532621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241860-5f76-4e7d-b7be-055615e96da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:02.532621 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241860-5f76-4e7d-b7be-055615e96da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:02.533293 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b5253-6770-4392-b2ca-483cccebc298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.533829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b5253-6770-4392-b2ca-483cccebc298 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.533926 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241860-5f76-4e7d-b7be-055615e96da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:02.535474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241860-5f76-4e7d-b7be-055615e96da7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:02.544692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 789/1564] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:05:02.545362 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 776/1565] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:05:10.061869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.062472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.062577 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.108301 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:10.109838 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:10.113286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.114150 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.114432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.151637 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] MFA Rules not processed for user `61da777a46a042a3ba0e47e1ceef5f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:10.154107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:10.230745 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 790/1566] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:10.231596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.256135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870664c-b58e-47ba-b814-2c1493887493 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.265315 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.266847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.267890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.268321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.269299 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.273261 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.283605 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 777/1567] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:10.289066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.304909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c379cf1-3c3a-47ad-a071-fd8263f4fb65 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.310786 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.311692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.311976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.312280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.312985 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.314919 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.432882 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 778/1568] 10.222.0.122 () {60 vars in 1158 bytes} [Fri Aug 26 01:05:10 2022] POST /identity/v3/projects => generated 386 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:05:10.436783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.443520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 791/1569] 10.222.0.122 () {60 vars in 1158 bytes} [Fri Aug 26 01:05:10 2022] POST /identity/v3/projects => generated 378 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:05:10.447340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.462327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:10.874424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256037f-be53-4bed-a5bf-e09577ab8516 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.874424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.874424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.874424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.876921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.877389 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997516f-9337-4631-a2c7-4247d87b0524 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.877752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.877752 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.878207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.878207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.878207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.878207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.879028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.879028 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.880118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:10.880213 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 792/1570] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 01:05:10 2022] POST /identity/v3/users => generated 296 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:05:10.880285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 779/1571] 10.222.0.122 () {60 vars in 1149 bytes} [Fri Aug 26 01:05:10 2022] POST /identity/v3/users => generated 300 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:05:10.880475 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.880663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.880663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98eea0-a782-45ae-90cb-73b4326dfcd0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.880821 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083c87-d3a7-4c4a-851f-30458c33a35d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.880891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.880891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.880891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.880891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.881175 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.881233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.881233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.881233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.881233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.881568 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.881643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.881643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.881754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 780/1572] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:10 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:05:10.881754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.881861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 793/1573] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:10 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:05:10.881861 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:10.882002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9592c4-ae8f-485d-a4d6-e30d690e829d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.882133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ec7b-b120-4790-8c10-a685af57ffd7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:10.882248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.882248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.882248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.882248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] PATH_INFO: `/v3/projects/86ed5914d4dd4646aa8f934bb3719864/users/9a4f5e10b1ed42bd96a2e4b14959e5dc/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.882493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:10.882493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:10.882493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:10.882493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] PATH_INFO: `/v3/projects/7e1ce8e630b9430d9c18cf2eaf5c7081/users/23c8ba0ddda045a290c9b6019b3192fa/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:10.893347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ed5914d4dd4646aa8f934bb3719864, user_id=9a4f5e10b1ed42bd96a2e4b14959e5dc, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.895748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1ce8e630b9430d9c18cf2eaf5c7081, user_id=23c8ba0ddda045a290c9b6019b3192fa, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:10.900765 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:10.903226 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:11.138478 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 781/1574] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:05:10 2022] PUT /identity/v3/projects/86ed5914d4dd4646aa8f934bb3719864/users/9a4f5e10b1ed42bd96a2e4b14959e5dc/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:11.142201 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:11.170953 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 794/1575] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:05:10 2022] PUT /identity/v3/projects/7e1ce8e630b9430d9c18cf2eaf5c7081/users/23c8ba0ddda045a290c9b6019b3192fa/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:11.175905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:11.265335 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990038-93ba-4603-a024-3a0668b6fb0a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:11.314954 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be95d4b-0700-4979-99f0-6ea341ecb5b6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:11.321109 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:11.321766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:11.322051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:11.322329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:11.322991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:11.324691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:11.338250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 795/1576] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:11 2022] GET /identity/v3/roles => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:05:11.342543 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:11.354774 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaf2d-8baa-4698-b0b2-9dbfcbeffee3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:11.356722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:11.357534 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:11.357818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:11.358087 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:11.359174 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:11.359639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57721b-f780-430d-9fa7-c5f0558a3043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:11.360353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57721b-f780-430d-9fa7-c5f0558a3043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:11.360638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57721b-f780-430d-9fa7-c5f0558a3043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:11.360917 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57721b-f780-430d-9fa7-c5f0558a3043 admin admin] PATH_INFO: `/v3/projects/7e1ce8e630b9430d9c18cf2eaf5c7081/users/23c8ba0ddda045a290c9b6019b3192fa/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:11.362600 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:11.363187 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57721b-f780-430d-9fa7-c5f0558a3043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1ce8e630b9430d9c18cf2eaf5c7081, user_id=23c8ba0ddda045a290c9b6019b3192fa, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:11.365974 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57721b-f780-430d-9fa7-c5f0558a3043 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:11.381287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 782/1577] 10.222.0.122 () {58 vars in 1127 bytes} [Fri Aug 26 01:05:11 2022] GET /identity/v3/roles => generated 1427 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:05:11.384258 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 796/1578] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:05:11 2022] PUT /identity/v3/projects/7e1ce8e630b9430d9c18cf2eaf5c7081/users/23c8ba0ddda045a290c9b6019b3192fa/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:11.387860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:11.396700 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98533aa-0dea-4168-87c3-0186832a3c04 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:11.466438 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:11.467127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:11.467410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:11.467686 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] PATH_INFO: `/v3/projects/86ed5914d4dd4646aa8f934bb3719864/users/9a4f5e10b1ed42bd96a2e4b14959e5dc/roles/efabcc00ebde48babd14a43e59a6e6b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:11.472512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ed5914d4dd4646aa8f934bb3719864, user_id=9a4f5e10b1ed42bd96a2e4b14959e5dc, role_id=efabcc00ebde48babd14a43e59a6e6b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:11.475233 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:11.482639 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:11.492630 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 783/1579] 10.222.0.122 () {60 vars in 1488 bytes} [Fri Aug 26 01:05:11 2022] PUT /identity/v3/projects/86ed5914d4dd4646aa8f934bb3719864/users/9a4f5e10b1ed42bd96a2e4b14959e5dc/roles/efabcc00ebde48babd14a43e59a6e6b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:05:19.011431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceed67-433b-4394-9c7a-60cf54a51c9c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:19.012495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceed67-433b-4394-9c7a-60cf54a51c9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:19.013102 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceed67-433b-4394-9c7a-60cf54a51c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:19.052127 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-79ceed67-433b-4394-9c7a-60cf54a51c9c None None] MFA Rules not processed for user `23c8ba0ddda045a290c9b6019b3192fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:19.054646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-79ceed67-433b-4394-9c7a-60cf54a51c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:19.097269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:19.161685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 797/1580] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:19.177904 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:19.180931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:19.292100 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720ab40-c19a-4094-a0ba-ee5593c0aa0e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:19.296561 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db0844a1faa142d2a469fe561e4b72ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:19.297275 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:19.297641 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:19.297989 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:19.311687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919b5c-a29f-4fd7-b9b4-eacd6efd666a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:19.311977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919b5c-a29f-4fd7-b9b4-eacd6efd666a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:19.312285 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919b5c-a29f-4fd7-b9b4-eacd6efd666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:19.349337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3d919b5c-a29f-4fd7-b9b4-eacd6efd666a None None] MFA Rules not processed for user `9a4f5e10b1ed42bd96a2e4b14959e5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:19.351583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3d919b5c-a29f-4fd7-b9b4-eacd6efd666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:19.386823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:19.388514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:19.401803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 784/1581] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:19.458835 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 798/1582] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:19.482019 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:19.497836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e566b-be15-46f4-8408-21009dfa786c service glance] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:19.504505 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db0844a1faa142d2a469fe561e4b72ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:19.505624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:19.506198 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:19.506818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:19.614948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:19.619367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:19.628194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 785/1583] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:20.062575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445c6d-6157-4c48-8118-5b731a618f61 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:20.063088 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445c6d-6157-4c48-8118-5b731a618f61 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:20.063176 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445c6d-6157-4c48-8118-5b731a618f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:20.133530 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9a445c6d-6157-4c48-8118-5b731a618f61 None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:20.134888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9a445c6d-6157-4c48-8118-5b731a618f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:20.225502 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 799/1584] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:20.643421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:20.645496 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:20.700876 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:20.797888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35d8c-019a-4e3d-abb7-4e89681bd136 service glance] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:20.804506 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:20.805136 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:20.805696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:20.805696 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:20.819659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:20.822079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:20.832803 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 786/1585] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:05:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:21.826379 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d92e-c287-40c8-a586-c5c97e13f2c6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:21.826837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d92e-c287-40c8-a586-c5c97e13f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:21.826837 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2d92e-c287-40c8-a586-c5c97e13f2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:21.853757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5ce2d92e-c287-40c8-a586-c5c97e13f2c6 None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:21.855025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5ce2d92e-c287-40c8-a586-c5c97e13f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:21.863083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 800/1586] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:21.880384 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:21.904407 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a00c-f6a0-47e9-9b20-14d92618a148 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:21.910874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bab9b-ea9a-4618-94e6-a03edbe27d59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:21.911887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bab9b-ea9a-4618-94e6-a03edbe27d59 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:21.912340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bab9b-ea9a-4618-94e6-a03edbe27d59 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:21.912820 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bab9b-ea9a-4618-94e6-a03edbe27d59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:21.923131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bab9b-ea9a-4618-94e6-a03edbe27d59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:21.924757 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bab9b-ea9a-4618-94e6-a03edbe27d59 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:21.938666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 787/1587] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 01:05:31.844712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:31.930382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=33 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:32.326296 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3db50c-d9d7-4d97-9a04-6f9d6c5efe55 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:32.326487 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3db50c-d9d7-4d97-9a04-6f9d6c5efe55 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:32.327059 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3db50c-d9d7-4d97-9a04-6f9d6c5efe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:32.348089 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0c3db50c-d9d7-4d97-9a04-6f9d6c5efe55 None None] MFA Rules not processed for user `61da777a46a042a3ba0e47e1ceef5f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:32.349363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c3db50c-d9d7-4d97-9a04-6f9d6c5efe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:32.356491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 801/1588] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:32.654767 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6687-4782-4d3f-83e4-17de710313cb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:32.655140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6687-4782-4d3f-83e4-17de710313cb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:32.655423 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6687-4782-4d3f-83e4-17de710313cb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:32.656781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 788/1589] 10.222.0.122 () {54 vars in 967 bytes} [Fri Aug 26 01:05:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:32.662601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63025c-5207-4bc3-8957-897b29f2a159 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:32.669728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63025c-5207-4bc3-8957-897b29f2a159 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:32.669728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63025c-5207-4bc3-8957-897b29f2a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:32.705149 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-df63025c-5207-4bc3-8957-897b29f2a159 None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:32.706385 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-df63025c-5207-4bc3-8957-897b29f2a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:32.780984 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 802/1590] 10.222.0.122 () {58 vars in 1064 bytes} [Fri Aug 26 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:32.786294 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309464-054b-41e8-8d92-c0097a9165d0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:32.790095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309464-054b-41e8-8d92-c0097a9165d0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:32.790095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309464-054b-41e8-8d92-c0097a9165d0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:32.790095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 789/1591] 10.222.0.122 () {54 vars in 917 bytes} [Fri Aug 26 01:05:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:32.794921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a34e-1b88-467d-ae32-7d3f1ab26b2b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:32.795200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a34e-1b88-467d-ae32-7d3f1ab26b2b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:32.795535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a34e-1b88-467d-ae32-7d3f1ab26b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:32.815749 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dfe1a34e-1b88-467d-ae32-7d3f1ab26b2b None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:32.816986 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dfe1a34e-1b88-467d-ae32-7d3f1ab26b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:32.826206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 803/1592] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:32.838283 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309464-054b-41e8-8d92-c0097a9165d0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:32.839970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c5309464-054b-41e8-8d92-c0097a9165d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:32.854023 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309464-054b-41e8-8d92-c0097a9165d0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:32.857789 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3353-d04b-46d3-b1f3-702699f9a961 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db0844a1faa142d2a469fe561e4b72ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:32.858421 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3353-d04b-46d3-b1f3-702699f9a961 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:32.858721 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3353-d04b-46d3-b1f3-702699f9a961 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:32.859011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3353-d04b-46d3-b1f3-702699f9a961 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:32.870826 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3353-d04b-46d3-b1f3-702699f9a961 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:32.874925 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3353-d04b-46d3-b1f3-702699f9a961 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:32.887085 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 790/1593] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:33.240092 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677278fd-a129-4e8a-869f-621d48083439 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:33.240833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677278fd-a129-4e8a-869f-621d48083439 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:33.240833 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677278fd-a129-4e8a-869f-621d48083439 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:33.242017 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 804/1594] 10.222.0.122 () {54 vars in 917 bytes} [Fri Aug 26 01:05:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:33.247819 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeec6d-df5b-40c9-a49b-5b699692f507 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:33.248341 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeec6d-df5b-40c9-a49b-5b699692f507 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:33.248432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeec6d-df5b-40c9-a49b-5b699692f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:33.288374 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5cdeec6d-df5b-40c9-a49b-5b699692f507 None None] MFA Rules not processed for user `74c23495decd4d5e8a0a8ae47935ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:33.289640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5cdeec6d-df5b-40c9-a49b-5b699692f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:33.341675 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 791/1595] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:33.353594 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677278fd-a129-4e8a-869f-621d48083439 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:33.364622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677278fd-a129-4e8a-869f-621d48083439 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:33.368336 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d78209-d833-4dbd-bfa1-596f43d0d2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:33.368895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d78209-d833-4dbd-bfa1-596f43d0d2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:33.369180 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d78209-d833-4dbd-bfa1-596f43d0d2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:33.369451 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d78209-d833-4dbd-bfa1-596f43d0d2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:33.377705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d78209-d833-4dbd-bfa1-596f43d0d2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:33.379410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d78209-d833-4dbd-bfa1-596f43d0d2e4 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:33.388860 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 805/1596] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:33.942829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393ddf-ee0d-42fa-b1c9-ceb2267469bd None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:33.943257 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393ddf-ee0d-42fa-b1c9-ceb2267469bd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:33.944147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393ddf-ee0d-42fa-b1c9-ceb2267469bd None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:33.945535 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 792/1597] 10.222.0.122 () {54 vars in 967 bytes} [Fri Aug 26 01:05:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:33.951783 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768332ea-ee10-4c2a-8f4c-2a235ceffb1b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:33.951940 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768332ea-ee10-4c2a-8f4c-2a235ceffb1b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:33.952234 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768332ea-ee10-4c2a-8f4c-2a235ceffb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:33.971205 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393ddf-ee0d-42fa-b1c9-ceb2267469bd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:33.973580 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-768332ea-ee10-4c2a-8f4c-2a235ceffb1b None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:33.976021 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-768332ea-ee10-4c2a-8f4c-2a235ceffb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:33.985879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 806/1598] 10.222.0.122 () {58 vars in 1064 bytes} [Fri Aug 26 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:33.993083 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823f0e-59c8-4a7f-93d9-5613cc8a54ba None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:33.993332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823f0e-59c8-4a7f-93d9-5613cc8a54ba None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:33.993604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823f0e-59c8-4a7f-93d9-5613cc8a54ba None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:33.994941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 807/1599] 10.222.0.122 () {54 vars in 917 bytes} [Fri Aug 26 01:05:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:33.999845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:34.000332 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:34.000606 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:34.021562 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:34.023485 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:34.033512 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 808/1600] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:05:34.047840 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:34.059483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393ddf-ee0d-42fa-b1c9-ceb2267469bd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:34.065412 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:34.066064 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:34.066417 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:34.066601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:34.067494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f141aa0-83f5-4274-89ae-d6ab280e867c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:34.068578 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:34.071523 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a1e3-bb24-4750-b33c-eda026e734c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:34.072141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a1e3-bb24-4750-b33c-eda026e734c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:34.072463 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a1e3-bb24-4750-b33c-eda026e734c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:34.072748 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a1e3-bb24-4750-b33c-eda026e734c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:34.081008 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:34.086337 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:34.086448 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a1e3-bb24-4750-b33c-eda026e734c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:34.086987 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a1e3-bb24-4750-b33c-eda026e734c1 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:34.102936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 809/1601] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:34.105858 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 793/1602] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:05:37.659503 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63520f-5e15-47ce-bacb-9413ccdfdc54 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:37.660256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63520f-5e15-47ce-bacb-9413ccdfdc54 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:37.660256 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63520f-5e15-47ce-bacb-9413ccdfdc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:37.688147 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fd63520f-5e15-47ce-bacb-9413ccdfdc54 None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:37.689716 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fd63520f-5e15-47ce-bacb-9413ccdfdc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:37.713843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 810/1603] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:37.729894 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:37.744467 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b969ad-2efd-4ca8-a895-488f68a8fcfa service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:37.749930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:37.750690 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:37.751058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:37.751547 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:37.761378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:37.763069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:37.772269 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 794/1604] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 01:05:47.683037 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=64 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:47.768798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=73 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:56.178622 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b02d-3771-44ee-84cf-f3d4b888e636 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:56.181680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b02d-3771-44ee-84cf-f3d4b888e636 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:56.181680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b02d-3771-44ee-84cf-f3d4b888e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:56.201223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bde9b02d-3771-44ee-84cf-f3d4b888e636 None None] MFA Rules not processed for user `74c23495decd4d5e8a0a8ae47935ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:56.202510 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bde9b02d-3771-44ee-84cf-f3d4b888e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:56.211945 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 811/1605] 10.222.0.40 () {58 vars in 1019 bytes} [Fri Aug 26 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:56.227054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:56.237660 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4a151-a13e-4849-a877-fafb7a1d1aba service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:56.241901 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51e9c-6130-4a1c-a393-9c84ef75e12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:56.242666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51e9c-6130-4a1c-a393-9c84ef75e12e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:56.243058 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51e9c-6130-4a1c-a393-9c84ef75e12e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:56.243514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51e9c-6130-4a1c-a393-9c84ef75e12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:56.252076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51e9c-6130-4a1c-a393-9c84ef75e12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:56.253546 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51e9c-6130-4a1c-a393-9c84ef75e12e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:56.263035 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 795/1606] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:56 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:57.309828 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d13a8-48b6-42b0-8bf3-05d130400cdb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:57.310790 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d13a8-48b6-42b0-8bf3-05d130400cdb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:57.311128 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d13a8-48b6-42b0-8bf3-05d130400cdb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:57.313331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 812/1607] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 01:05:57 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 01:05:57.337494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeb788-9e61-4059-824c-e19b68dc2464 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:57.339340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeb788-9e61-4059-824c-e19b68dc2464 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:57.339905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeb788-9e61-4059-824c-e19b68dc2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:57.378048 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aeaeb788-9e61-4059-824c-e19b68dc2464 None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:57.381949 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aeaeb788-9e61-4059-824c-e19b68dc2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:57.399705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 796/1608] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:57.424712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d13a8-48b6-42b0-8bf3-05d130400cdb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:57.443683 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d13a8-48b6-42b0-8bf3-05d130400cdb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:57.454443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5cc1e-7ca7-4cc1-aedd-63d907fb198e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:57.454443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5cc1e-7ca7-4cc1-aedd-63d907fb198e service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:57.454443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5cc1e-7ca7-4cc1-aedd-63d907fb198e service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:57.454443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5cc1e-7ca7-4cc1-aedd-63d907fb198e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:57.465740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5cc1e-7ca7-4cc1-aedd-63d907fb198e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:57.468020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5cc1e-7ca7-4cc1-aedd-63d907fb198e service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:57.486494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 813/1609] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:06:05.131574 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca485-4c06-4041-bcf8-79c3e267cbc1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:05.132551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca485-4c06-4041-bcf8-79c3e267cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:05.132551 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca485-4c06-4041-bcf8-79c3e267cbc1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:05.134799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 797/1610] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 01:06:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:06:05.145672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db297-79ce-4078-8d1b-8501a92577dd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:05.146656 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db297-79ce-4078-8d1b-8501a92577dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:05.147195 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db297-79ce-4078-8d1b-8501a92577dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:05.184522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-573db297-79ce-4078-8d1b-8501a92577dd None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:06:05.186727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-573db297-79ce-4078-8d1b-8501a92577dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:06:05.203724 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 814/1611] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:06:05.222172 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca485-4c06-4041-bcf8-79c3e267cbc1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:06:05.245877 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca485-4c06-4041-bcf8-79c3e267cbc1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:06:05.255454 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:06:05.256538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:05.257065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:05.257531 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:05.274791 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:06:05.277903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:06:05.299121 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 798/1612] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:06:15.176000 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=12 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:15.291255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=15 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:25.885122 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9675bb-0d0c-4d9e-8dde-a28a93a5c1bb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:25.885766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9675bb-0d0c-4d9e-8dde-a28a93a5c1bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:25.885766 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9675bb-0d0c-4d9e-8dde-a28a93a5c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:25.915868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6f9675bb-0d0c-4d9e-8dde-a28a93a5c1bb None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:06:25.917118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6f9675bb-0d0c-4d9e-8dde-a28a93a5c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:06:25.924173 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 815/1613] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:06:35.013521 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:06:35.023760 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1f360-806e-4df7-a8d9-14140e21dcdb service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:06:35.029164 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e605e-4ea1-4ec9-b3cf-51c97ff9214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:06:35.029970 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e605e-4ea1-4ec9-b3cf-51c97ff9214c service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:35.030306 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e605e-4ea1-4ec9-b3cf-51c97ff9214c service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:35.030808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e605e-4ea1-4ec9-b3cf-51c97ff9214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:35.051599 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e605e-4ea1-4ec9-b3cf-51c97ff9214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:06:35.054490 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e605e-4ea1-4ec9-b3cf-51c97ff9214c service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:06:35.074629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 799/1614] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:06:35.911223 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:38.447243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6039186-31a0-4323-af56-26d8d6280fed None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:38.447931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6039186-31a0-4323-af56-26d8d6280fed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:38.447931 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6039186-31a0-4323-af56-26d8d6280fed None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:38.450134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 816/1615] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 01:06:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:06:38.457494 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853fad-6932-4546-b926-01330bfaa061 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:38.458369 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853fad-6932-4546-b926-01330bfaa061 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:38.458829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853fad-6932-4546-b926-01330bfaa061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:38.483200 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-03853fad-6932-4546-b926-01330bfaa061 None None] MFA Rules not processed for user `7fd5dcca78134cbcaba474e435c7fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:06:38.484746 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-03853fad-6932-4546-b926-01330bfaa061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:06:38.501029 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 800/1616] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:06:38.521273 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6039186-31a0-4323-af56-26d8d6280fed None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:06:38.537728 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6039186-31a0-4323-af56-26d8d6280fed None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:06:38.547348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219b9c-0ecb-470f-9eb4-93a824983c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:06:38.547348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219b9c-0ecb-470f-9eb4-93a824983c8b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:06:38.547348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219b9c-0ecb-470f-9eb4-93a824983c8b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:06:38.547348 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219b9c-0ecb-470f-9eb4-93a824983c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:06:38.559982 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54219b9c-0ecb-470f-9eb4-93a824983c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:06:38.561891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54219b9c-0ecb-470f-9eb4-93a824983c8b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:06:38.575866 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 817/1617] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:06:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:06:48.477308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:06:48.569458 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:34.759207 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:34.759865 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:34.760118 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:34.790670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:34.791976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:34.799684 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 801/1618] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:35.147770 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95044-f88b-46fa-952d-4068f9d9ca4f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:35.148443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95044-f88b-46fa-952d-4068f9d9ca4f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:35.148443 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95044-f88b-46fa-952d-4068f9d9ca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:35.171495 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-86c95044-f88b-46fa-952d-4068f9d9ca4f None None] MFA Rules not processed for user `74c23495decd4d5e8a0a8ae47935ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:35.173141 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-86c95044-f88b-46fa-952d-4068f9d9ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:35.180210 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 818/1619] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:35.193401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:35.205194 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b7544-caef-4c3f-b081-1fb2aaf47eeb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:35.209557 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:35.210356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:35.210681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:35.210995 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:35.221170 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:35.222892 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:35.232065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 802/1620] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:07:35 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:07:45.164627 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:45.228288 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:58.680801 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35c46-f25e-436a-a136-e46243226d32 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:58.681644 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35c46-f25e-436a-a136-e46243226d32 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:58.682006 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35c46-f25e-436a-a136-e46243226d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:58.718924 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b0d35c46-f25e-436a-a136-e46243226d32 None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:58.720983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b0d35c46-f25e-436a-a136-e46243226d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:58.732134 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 819/1621] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:58.792787 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:58.815948 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb300d4a-eaa7-4a8f-9e57-f6ddf77cd05a service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:58.824297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675a2b-c8a5-4e58-a887-85496654fe63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:58.825891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675a2b-c8a5-4e58-a887-85496654fe63 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:58.826585 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675a2b-c8a5-4e58-a887-85496654fe63 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:58.827062 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675a2b-c8a5-4e58-a887-85496654fe63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:58.843579 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7675a2b-c8a5-4e58-a887-85496654fe63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:58.846659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7675a2b-c8a5-4e58-a887-85496654fe63 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:58.864297 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 803/1622] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 01:08:04.533135 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f4e4-6a14-4967-8ddd-14dd8497f406 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:04.533685 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f4e4-6a14-4967-8ddd-14dd8497f406 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:04.533967 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f4e4-6a14-4967-8ddd-14dd8497f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:04.557643 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c162f4e4-6a14-4967-8ddd-14dd8497f406 None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:04.559036 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c162f4e4-6a14-4967-8ddd-14dd8497f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:04.567410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 820/1623] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:08:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:08.856397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:14.551618 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:38.570583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3275bf7-697e-43b7-8262-60a48d3c78c9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:38.571513 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3275bf7-697e-43b7-8262-60a48d3c78c9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:38.571681 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3275bf7-697e-43b7-8262-60a48d3c78c9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:38.574395 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 804/1624] 10.222.0.122 () {54 vars in 966 bytes} [Fri Aug 26 01:08:38 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:08:38.580664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82006c-fd2c-49ec-a722-4454f42c5a93 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:38.581491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82006c-fd2c-49ec-a722-4454f42c5a93 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:38.581491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82006c-fd2c-49ec-a722-4454f42c5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:38.605319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ad82006c-fd2c-49ec-a722-4454f42c5a93 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:38.606780 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ad82006c-fd2c-49ec-a722-4454f42c5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:38.617943 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 821/1625] 10.222.0.122 () {58 vars in 1063 bytes} [Fri Aug 26 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:08:38.627875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3275bf7-697e-43b7-8262-60a48d3c78c9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:38.645491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3275bf7-697e-43b7-8262-60a48d3c78c9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:38.652529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:38.653208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:38.653601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:38.653966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:38.665235 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:38.668529 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:38.683689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 805/1626] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:08:38 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:08:48.429796 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d256d3-28a2-407f-b212-f7556528c67d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:48.430444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d256d3-28a2-407f-b212-f7556528c67d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:48.430444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d256d3-28a2-407f-b212-f7556528c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:48.451817 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-80d256d3-28a2-407f-b212-f7556528c67d None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:48.453133 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-80d256d3-28a2-407f-b212-f7556528c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:48.461634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 822/1627] 10.222.0.122 () {58 vars in 972 bytes} [Fri Aug 26 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:48.475731 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:48.494071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938dd7f-6757-4ca9-bac0-c2d2df8a9dc6 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:48.499632 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:48.500416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:48.500703 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:48.500977 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:48.511466 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:48.513117 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:48.522353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 806/1628] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 01:08:58.445674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:58.518754 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=12 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:21.702950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:21.703797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:21.704314 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:21.740659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:21.744056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:21.756428 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 823/1629] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:31.731868 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:43.582859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:43.601413 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373acae-dfac-428d-9808-07bd5243766f service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:43.607896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:43.608988 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:43.609501 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:43.609979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:43.628350 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:43.631822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:43.652317 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 807/1630] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:53.642659 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:03.360325 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:03.375093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41dd8-ff6f-405d-aaec-81b94eb0dc3a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:03.381698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:03.382677 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:03.383065 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:03.383416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:03.399634 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:03.401707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:03.412905 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 824/1631] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:03.504410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:03.518193 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8a466-48fe-4197-af7b-cd3130798852 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:03.524739 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:03.525759 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:03.526247 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:03.526722 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:03.546736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:03.557891 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:03.572188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 808/1632] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:11:04.273969 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:04.290962 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e07-e5f3-4d53-a102-fe7866e4045c service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:04.307667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:04.309051 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:04.309168 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:04.309548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:04.327813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:04.347286 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:04.351707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 825/1633] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:04.479921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:04.494431 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f9a1c-f271-454d-b721-d15dec881b9e service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:04.502381 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791c185-86d2-49a2-8114-2a108774be07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:04.503522 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791c185-86d2-49a2-8114-2a108774be07 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:04.504004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791c185-86d2-49a2-8114-2a108774be07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:04.504457 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791c185-86d2-49a2-8114-2a108774be07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:04.518942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791c185-86d2-49a2-8114-2a108774be07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:04.521666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791c185-86d2-49a2-8114-2a108774be07 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:04.533138 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 809/1634] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:04 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:06.606004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:06.734588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a32a-f020-4623-9b50-5437d237daa4 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:06.741678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77f464caecc4799b2c310ea640a3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:06.742723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:06.743209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:06.743691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:06.771240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:06.771240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:06.787232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 826/1635] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:11:14.527701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=12 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:16.383358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3e3be-0757-4a6d-9ea3-d5dfeaae076e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:16.384098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3e3be-0757-4a6d-9ea3-d5dfeaae076e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:16.384329 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3e3be-0757-4a6d-9ea3-d5dfeaae076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:16.418941 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-18d3e3be-0757-4a6d-9ea3-d5dfeaae076e None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:16.421804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-18d3e3be-0757-4a6d-9ea3-d5dfeaae076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:16.432099 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 810/1636] 10.222.0.122 () {58 vars in 972 bytes} [Fri Aug 26 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:16.598305 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:16.617664 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a493ab-2b05-4f07-aa2f-2693c9e199e4 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:16.626755 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:16.627672 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:16.628098 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:16.628591 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:16.643944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:16.647055 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:16.663575 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 827/1637] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:11:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 01:11:18.453528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f465ea-45f0-4c0e-95b1-a5a8ad8129ac None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:18.454105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f465ea-45f0-4c0e-95b1-a5a8ad8129ac None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:18.454105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f465ea-45f0-4c0e-95b1-a5a8ad8129ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:18.474743 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-48f465ea-45f0-4c0e-95b1-a5a8ad8129ac None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:18.475983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-48f465ea-45f0-4c0e-95b1-a5a8ad8129ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:18.486411 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 811/1638] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:18.497916 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:18.515646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293389f-bf09-4403-afd5-adb88eaec6c8 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:18.520999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:18.521629 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:18.521909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:18.522181 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:18.532177 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:18.533798 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:18.542688 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 828/1639] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 01:11:28.469582 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:28.539308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=50 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:31.034723 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a66ee-7482-4c06-bd33-3d18e15e8305 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:31.036321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a66ee-7482-4c06-bd33-3d18e15e8305 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:31.036321 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a66ee-7482-4c06-bd33-3d18e15e8305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:31.061869 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-772a66ee-7482-4c06-bd33-3d18e15e8305 None None] MFA Rules not processed for user `61da777a46a042a3ba0e47e1ceef5f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:31.063573 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-772a66ee-7482-4c06-bd33-3d18e15e8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:31.074240 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 812/1640] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:32.001401 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:32.020588 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94262b-ef3d-4b96-8eab-970088c4dbd1 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:32.031114 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:32.032005 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:32.032347 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:32.032691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:32.045291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:32.047670 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:32.065854 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 829/1641] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:35.626079 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:35.626649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:35.626649 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:35.648307 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:35.649548 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:35.659474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 813/1642] 10.222.0.122 () {58 vars in 1014 bytes} [Fri Aug 26 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:11:35.673243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:35.685422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e2d6-06ba-4e23-9f79-91b277d89719 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:35.691011 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:35.691638 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:35.692069 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:35.692328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:35.705753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:35.707422 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:35.717957 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 830/1643] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 01:11:45.641807 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:45.713358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=12 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:52.887107 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:52.905736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430970d-4051-44df-9ec8-24488eadc13b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:52.913818 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:52.914418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:52.914707 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:52.915105 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:52.925921 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:52.930702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:52.944493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 814/1644] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:12:02.936952 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:12:10.467429 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:12:10.478465 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a97e-8a0e-4bb9-ba46-b5c283a90104 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:12:10.483078 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7b927-5707-4fce-a177-34e810619c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:12:10.483727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b927-5707-4fce-a177-34e810619c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:10.484007 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b927-5707-4fce-a177-34e810619c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:10.484327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b927-5707-4fce-a177-34e810619c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:10.496300 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7b927-5707-4fce-a177-34e810619c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:12:10.497847 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7b927-5707-4fce-a177-34e810619c11 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:12:10.509372 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 831/1645] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:12:10.981139 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:12:11.004526 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35173d-d886-460d-a9f2-e624dc64457f service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:12:11.014095 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:12:11.015096 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:11.015378 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:11.015654 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:11.027939 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:12:11.029802 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:12:11.040667 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 815/1646] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:12:19.716604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:19.716604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:19.716604 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:19.736626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:12:19.738022 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:12:19.748397 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 832/1647] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:12:21.036071 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:12:29.730620 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=9 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:12:45.052680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:12:45.066248 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f553-c5f8-43d2-8345-032d7133c459 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:12:45.072898 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713401d6-6285-47ba-b061-a1521493f263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:12:45.073669 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713401d6-6285-47ba-b061-a1521493f263 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:45.073951 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713401d6-6285-47ba-b061-a1521493f263 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:45.074227 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713401d6-6285-47ba-b061-a1521493f263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:45.084538 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713401d6-6285-47ba-b061-a1521493f263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:12:45.087132 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713401d6-6285-47ba-b061-a1521493f263 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:12:45.099624 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 816/1648] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:12:55.094354 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:14:13.382052 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:14:13.383692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:13.549241 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0ecb-b25a-404c-91b2-974b0961d50b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:14:13.555287 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:14:13.556041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:13.556447 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:13.556878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:13.559280 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:13.573056 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:14:13.574804 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:14:13.586424 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 833/1649] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:14:23.581829 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=37 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:14:47.387479 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:47.388225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:47.388514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:47.444896 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] MFA Rules not processed for user `7614b7f05486411395a209e34ef5624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:14:47.446999 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:47.474778 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 817/1650] 10.222.0.122 () {58 vars in 972 bytes} [Fri Aug 26 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:14:47.529416 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:14:47.541756 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae31db-f64a-425c-bb55-c09fadbf7539 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:14:47.548845 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a1ae1-e02a-43f5-9011-04250e4ab89d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42193a1473a0485787f60b5bd963e7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:14:47.549602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1ae1-e02a-43f5-9011-04250e4ab89d service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:47.549965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1ae1-e02a-43f5-9011-04250e4ab89d service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:47.550326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1ae1-e02a-43f5-9011-04250e4ab89d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:47.560856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a1ae1-e02a-43f5-9011-04250e4ab89d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:14:47.562508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a1ae1-e02a-43f5-9011-04250e4ab89d service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:14:47.574377 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 834/1651] 10.222.0.122 () {60 vars in 1389 bytes} [Fri Aug 26 01:14:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 01:14:49.144979 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:14:49.148318 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:49.203981 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518c21c-f3be-4366-bbae-51b59fbe8989 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:14:49.211482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1975a-c359-44fa-99c5-0b4d17974a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:14:49.211482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1975a-c359-44fa-99c5-0b4d17974a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:49.211482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1975a-c359-44fa-99c5-0b4d17974a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:49.211482 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1975a-c359-44fa-99c5-0b4d17974a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:49.295246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1975a-c359-44fa-99c5-0b4d17974a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:14:49.296983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1975a-c359-44fa-99c5-0b4d17974a66 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:14:49.321308 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 818/1652] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:14:54.478878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d198-e38e-49ed-ba56-6de90246e222 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:54.479472 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d198-e38e-49ed-ba56-6de90246e222 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:54.479808 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d198-e38e-49ed-ba56-6de90246e222 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:54.481910 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 835/1653] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 01:14:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:14:54.495907 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d872b-941e-4cf2-a835-1ea0f19a1b88 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:54.496663 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d872b-941e-4cf2-a835-1ea0f19a1b88 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:54.497033 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d872b-941e-4cf2-a835-1ea0f19a1b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:54.579584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-269d872b-941e-4cf2-a835-1ea0f19a1b88 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:14:54.581203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-269d872b-941e-4cf2-a835-1ea0f19a1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:54.592209 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 819/1654] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:14:54.612097 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d198-e38e-49ed-ba56-6de90246e222 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:14:54.628486 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d198-e38e-49ed-ba56-6de90246e222 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:14:54.635935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec9090-44a4-4332-b997-b380fa55916e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:14:54.636587 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec9090-44a4-4332-b997-b380fa55916e service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:54.636856 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec9090-44a4-4332-b997-b380fa55916e service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:54.637460 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec9090-44a4-4332-b997-b380fa55916e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:54.649433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec9090-44a4-4332-b997-b380fa55916e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:14:54.652303 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec9090-44a4-4332-b997-b380fa55916e service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:14:54.668277 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 836/1655] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:14:59.881068 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae4160-64c4-4907-bc6a-568162e55ae9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:59.881830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae4160-64c4-4907-bc6a-568162e55ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:59.881830 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae4160-64c4-4907-bc6a-568162e55ae9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:59.883662 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 820/1656] 10.222.0.122 () {54 vars in 926 bytes} [Fri Aug 26 01:14:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:14:59.956694 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:59.957295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:59.957295 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:59.986075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] MFA Rules not processed for user `2d8983239be74a3b86f60693bd8570cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:14:59.987470 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:59.996740 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 837/1657] 10.222.0.122 () {58 vars in 1023 bytes} [Fri Aug 26 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:15:00.009075 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae4160-64c4-4907-bc6a-568162e55ae9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:00.023991 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae4160-64c4-4907-bc6a-568162e55ae9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:00.029859 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f35543-4a29-4910-ac9a-55a61eb24657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:00.030784 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f35543-4a29-4910-ac9a-55a61eb24657 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:00.031106 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f35543-4a29-4910-ac9a-55a61eb24657 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:00.031515 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f35543-4a29-4910-ac9a-55a61eb24657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:00.043262 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f35543-4a29-4910-ac9a-55a61eb24657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:00.044928 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f35543-4a29-4910-ac9a-55a61eb24657 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:00.057581 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 821/1658] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:15:00 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:15:00.116851 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:00.131410 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97a6e5-f715-4f2d-87f1-8edd3232e155 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:00.136978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:00.138076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:00.138199 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:00.138464 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] PATH_INFO: `/v3/users/61da777a46a042a3ba0e47e1ceef5f4c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:00.139822 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61da777a46a042a3ba0e47e1ceef5f4c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:00.140879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: WARNING py.warnings [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:15:00.140879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: warnings.warn(msg) Aug 26 01:15:00.140879 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: Aug 26 01:15:00.143481 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:00.362942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:00.366567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:00.366567 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:00.387966 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] MFA Rules not processed for user `51636264c13e442092f054934e32f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:15:00.389418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:00.397895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 822/1659] 10.222.0.122 () {58 vars in 963 bytes} [Fri Aug 26 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:15:00.432066 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61da777a46a042a3ba0e47e1ceef5f4c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:00.557439 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61da777a46a042a3ba0e47e1ceef5f4c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:00.558524 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61da777a46a042a3ba0e47e1ceef5f4c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:00.577339 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61da777a46a042a3ba0e47e1ceef5f4c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:00.578666 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61da777a46a042a3ba0e47e1ceef5f4c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:00.620593 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 838/1660] 10.222.0.122 () {58 vars in 1229 bytes} [Fri Aug 26 01:15:00 2022] DELETE /identity/v3/users/61da777a46a042a3ba0e47e1ceef5f4c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:15:00.883444 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:00.894736 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa2b41-6ef7-490c-9431-b2b1e327367b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:00.948863 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:15:00.956197 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:00.956944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:00.957291 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:00.957640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:00.959935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:00.971480 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:00.973219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:00.983272 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 823/1661] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:15:00 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:15:01.027601 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:01.030094 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:01.154255 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d4ba2-7db1-49ca-a96b-bf1e20b6ad07 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:01.162388 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:01.163208 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:01.163674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:01.164188 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] PATH_INFO: `/v3/projects/474041b004b74f83a55cb1e0bf0c2e94` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:01.166268 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474041b004b74f83a55cb1e0bf0c2e94)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:01.169993 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:01.363013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:15:01.379206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474041b004b74f83a55cb1e0bf0c2e94', 'request_id': 'req-7841a5b7-dbe9-4504-ae79-5067593922b8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.462511 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474041b004b74f83a55cb1e0bf0c2e94', 'request_id': 'req-7841a5b7-dbe9-4504-ae79-5067593922b8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.469692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474041b004b74f83a55cb1e0bf0c2e94', 'request_id': 'req-7841a5b7-dbe9-4504-ae79-5067593922b8'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.483517 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] The token cache is being invalidate because project 474041b004b74f83a55cb1e0bf0c2e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:15:01.483775 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.484569 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.487222 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 839/1662] 10.222.0.122 () {58 vars in 1238 bytes} [Fri Aug 26 01:15:01 2022] DELETE /identity/v3/projects/474041b004b74f83a55cb1e0bf0c2e94 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:15:01.495243 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:01.508646 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d77d-071e-4580-b95b-ee9e8334b9b8 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:01.588875 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:01.590093 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:01.590583 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:01.591076 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] PATH_INFO: `/v3/users/9a4f5e10b1ed42bd96a2e4b14959e5dc` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:01.593214 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4f5e10b1ed42bd96a2e4b14959e5dc)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:01.598219 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:01.913358 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4f5e10b1ed42bd96a2e4b14959e5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.914331 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4f5e10b1ed42bd96a2e4b14959e5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.914687 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4f5e10b1ed42bd96a2e4b14959e5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:01.956978 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4f5e10b1ed42bd96a2e4b14959e5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.062333 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4f5e10b1ed42bd96a2e4b14959e5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.084611 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 824/1663] 10.222.0.122 () {58 vars in 1229 bytes} [Fri Aug 26 01:15:01 2022] DELETE /identity/v3/users/9a4f5e10b1ed42bd96a2e4b14959e5dc => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:15:02.481281 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:02.483935 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:02.509119 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a5b7-dbe9-4504-ae79-5067593922b8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:02.620781 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:02.622126 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:02.622528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:02.622980 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] PATH_INFO: `/v3/projects/86ed5914d4dd4646aa8f934bb3719864` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:02.624645 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ed5914d4dd4646aa8f934bb3719864)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:02.628680 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:02.763799 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ed5914d4dd4646aa8f934bb3719864', 'request_id': 'req-82592960-4a2e-4517-a942-65e55833c890'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.825349 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ed5914d4dd4646aa8f934bb3719864', 'request_id': 'req-82592960-4a2e-4517-a942-65e55833c890'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.833705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ed5914d4dd4646aa8f934bb3719864', 'request_id': 'req-82592960-4a2e-4517-a942-65e55833c890'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.848555 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] The token cache is being invalidate because project 86ed5914d4dd4646aa8f934bb3719864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:15:02.848878 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.849936 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:15:02.852025 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 840/1664] 10.222.0.122 () {58 vars in 1238 bytes} [Fri Aug 26 01:15:02 2022] DELETE /identity/v3/projects/86ed5914d4dd4646aa8f934bb3719864 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:15:12.077944 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:15:12.845131 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:15:22.233584 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:22.239327 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:22.343155 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14740c1-2fa8-41a5-b8fb-b1cea630e6c1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:22.442726 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:22.443432 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:22.443753 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:22.444086 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:22.446884 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:22.601920 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:22.604232 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:22.640832 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 825/1665] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:15:32.635968 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=83 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:16:19.003701 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:16:19.005705 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:16:19.023867 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82592960-4a2e-4517-a942-65e55833c890 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:16:19.028556 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:16:19.029217 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:16:19.029596 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:16:19.029890 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:16:19.032437 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:16:19.044651 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:16:19.046163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:16:19.058471 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 841/1666] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:16:29.053855 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:15.685013 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:15.694674 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479af4c-802f-4eeb-8766-727e3cebbb56 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:15.698603 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:15.699340 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:15.699491 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:15.699762 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:15.702002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:15.810204 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:15.811692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:15.833402 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 826/1667] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:16.885640 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:16.893493 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:17.086002 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d0625-5f9e-4430-b98b-916f26e59c49 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:17.094602 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd5dcca78134cbcaba474e435c7fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:17.095571 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:17.096018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:17.096484 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:17.099553 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:17.122626 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:17.126853 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:17.144319 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 842/1668] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:17:17.537689 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:17.547073 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ed9e-87fa-4f55-8ea7-0d6a671259a5 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:17.551895 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:17.552712 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:17.553062 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:17.553405 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:17.555326 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:17.571483 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:17.573034 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:17.586768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 827/1669] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:18.831661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:18.848477 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d80f-c9b9-4bdc-a39c-9ae1f0d5721c service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:18.854433 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:18.855386 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:18.855836 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:18.856316 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:18.859153 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:18.884418 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:18.887163 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:18.907382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 843/1670] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:18 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:27.581430 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=47 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:28.898772 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=49 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:34.567442 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:34.570103 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:34.589648 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2d8f-9ff5-4377-ac3e-d38271d1478a service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:34.596309 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c23495decd4d5e8a0a8ae47935ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:34.597361 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:34.597850 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:34.598367 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:34.601692 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:34.721160 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:34.722768 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:34.734702 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 828/1671] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:44.357260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:44.359950 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:44.382254 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cbf04-89de-4676-83f2-a605444ab578 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:44.388541 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:44.389813 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:44.390353 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:44.390874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] PATH_INFO: `/v3/users/51636264c13e442092f054934e32f0b3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:44.394196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=51636264c13e442092f054934e32f0b3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:44.398782 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:44.679031 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51636264c13e442092f054934e32f0b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:44.729250 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=30 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:44.785887 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51636264c13e442092f054934e32f0b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:44.786698 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51636264c13e442092f054934e32f0b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:44.795983 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51636264c13e442092f054934e32f0b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:44.796800 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51636264c13e442092f054934e32f0b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:44.819965 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 844/1672] 10.222.0.122 () {58 vars in 1229 bytes} [Fri Aug 26 01:17:44 2022] DELETE /identity/v3/users/51636264c13e442092f054934e32f0b3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:17:45.126909 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:45.145382 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3fd99-581d-40ca-bf0f-f66530ba8617 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:45.224729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:45.224729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:45.224729 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:45.225246 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] PATH_INFO: `/v3/projects/26af9156aa814fc1a38a6c2019025e74` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:45.226225 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26af9156aa814fc1a38a6c2019025e74)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:45.227266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:17:45.227266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 26 01:17:45.227266 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: Aug 26 01:17:45.228528 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:45.376942 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26af9156aa814fc1a38a6c2019025e74', 'request_id': 'req-de72c2a3-ec8c-4799-833c-c10f2610a520'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:45.403004 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26af9156aa814fc1a38a6c2019025e74', 'request_id': 'req-de72c2a3-ec8c-4799-833c-c10f2610a520'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:45.415206 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26af9156aa814fc1a38a6c2019025e74', 'request_id': 'req-de72c2a3-ec8c-4799-833c-c10f2610a520'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:45.523474 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] The token cache is being invalidate because project 26af9156aa814fc1a38a6c2019025e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:17:45.523727 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:45.524874 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:45.526549 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 829/1673] 10.222.0.122 () {58 vars in 1238 bytes} [Fri Aug 26 01:17:45 2022] DELETE /identity/v3/projects/26af9156aa814fc1a38a6c2019025e74 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:17:45.530976 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:45.533328 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:45.548763 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8c053-b30e-4c83-804f-de56eff07a2e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:45.634057 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:45.635363 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:45.635843 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:45.636370 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] PATH_INFO: `/v3/users/23c8ba0ddda045a290c9b6019b3192fa` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:45.638020 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c8ba0ddda045a290c9b6019b3192fa)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:45.640661 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:45.917508 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c8ba0ddda045a290c9b6019b3192fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.025334 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c8ba0ddda045a290c9b6019b3192fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.026054 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c8ba0ddda045a290c9b6019b3192fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.036732 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c8ba0ddda045a290c9b6019b3192fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.037559 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c8ba0ddda045a290c9b6019b3192fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.047911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:46.066903 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 845/1674] 10.222.0.122 () {58 vars in 1229 bytes} [Fri Aug 26 01:17:45 2022] DELETE /identity/v3/users/23c8ba0ddda045a290c9b6019b3192fa => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:17:46.372260 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:46.374263 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:46.400625 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72c2a3-ec8c-4799-833c-c10f2610a520 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:46.474811 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '609e79f5aa004dde93c22ba285ca6c56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18e8867d5ccb4ae190c4e3acc02760b8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:46.475356 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:46.475635 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:46.475908 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] PATH_INFO: `/v3/projects/7e1ce8e630b9430d9c18cf2eaf5c7081` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:46.477215 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1ce8e630b9430d9c18cf2eaf5c7081)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:46.479203 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:46.610930 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:46.626797 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1ce8e630b9430d9c18cf2eaf5c7081', 'request_id': 'req-4daf206f-ac9a-4347-83d8-7f7de2c120be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.634564 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1ce8e630b9430d9c18cf2eaf5c7081', 'request_id': 'req-4daf206f-ac9a-4347-83d8-7f7de2c120be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.641806 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1ce8e630b9430d9c18cf2eaf5c7081', 'request_id': 'req-4daf206f-ac9a-4347-83d8-7f7de2c120be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.767537 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] The token cache is being invalidate because project 7e1ce8e630b9430d9c18cf2eaf5c7081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:17:46.767779 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.768520 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4daf206f-ac9a-4347-83d8-7f7de2c120be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:17:46.770298 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 830/1675] 10.222.0.122 () {58 vars in 1238 bytes} [Fri Aug 26 01:17:46 2022] DELETE /identity/v3/projects/7e1ce8e630b9430d9c18cf2eaf5c7081 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:17:56.214140 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:56.848678 dv-osbrick-853500-2-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:20.318352 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:20.320514 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:20.420192 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa4b82-214b-4d21-82f3-9e6583a8010f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:20.504691 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d8983239be74a3b86f60693bd8570cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5259c7e6dd224f0a98a327306199f4af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:20.505565 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:20.505888 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:20.506196 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:20.516823 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:20.535070 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:20.537041 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf452ed-68c1-43f6-b5e4-afe642d98cb3 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:20.550911 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 846/1676] 10.222.0.122 () {60 vars in 1370 bytes} [Fri Aug 26 01:19:20 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:19:30.544018 dv-osbrick-853500-2-iscsi devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=58 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}